Jul 27 16:30:05 user nova-compute[71026]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 27 16:30:07 user nova-compute[71026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71026) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 16:30:07 user nova-compute[71026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71026) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 16:30:07 user nova-compute[71026]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71026) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 27 16:30:07 user nova-compute[71026]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:30:08 user nova-compute[71026]: INFO nova.virt.driver [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 27 16:30:08 user nova-compute[71026]: INFO nova.compute.provider_config [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Acquiring lock "singleton_lock" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Acquired lock "singleton_lock" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Releasing lock "singleton_lock" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Full set of CONF: {{(pid=71026) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ******************************************************************************** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Configuration options gathered from: {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ================================================================================ {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] allow_resize_to_same_host      = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] arq_binding_timeout            = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] backdoor_port                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] backdoor_socket                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] block_device_allocate_retries  = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] block_device_allocate_retries_interval = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cert                           = self.pem {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute_monitors               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] config_dir                     = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] config_drive_format            = iso9660 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] config_source                  = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] console_host                   = user {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] control_exchange               = nova {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cpu_allocation_ratio           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] daemon                         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] debug                          = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] default_access_ip_network_name = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] default_availability_zone      = nova {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] default_ephemeral_format       = ext4 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] default_schedule_zone          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] disk_allocation_ratio          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] enable_new_services            = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] enabled_apis                   = ['osapi_compute'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] enabled_ssl_apis               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] flat_injected                  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] force_config_drive             = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] force_raw_images               = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] graceful_shutdown_timeout      = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] heal_instance_info_cache_interval = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] host                           = user {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_build_timeout         = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_delete_interval       = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_format                = [instance: %(uuid)s]  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_name_template         = instance-%08x {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_usage_audit           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_usage_audit_period    = month {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] internal_service_availability_zone = internal {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] key                            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] live_migration_retry_count     = 30 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_config_append              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_dir                        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_file                       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_options                    = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_rotate_interval            = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_rotate_interval_type       = days {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] log_rotation_type              = none {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] long_rpc_timeout               = 1800 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_concurrent_builds          = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_concurrent_live_migrations = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_concurrent_snapshots       = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_local_block_devices        = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_logfile_count              = 30 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] max_logfile_size_mb            = 200 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] maximum_instance_delete_attempts = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metadata_listen                = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metadata_listen_port           = 8775 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metadata_workers               = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] migrate_max_retries            = -1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] mkisofs_cmd                    = genisoimage {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] my_ip                          = 10.0.0.210 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] network_allocate_retries       = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] osapi_compute_listen_port      = 8774 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] osapi_compute_unique_server_name_scope =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] osapi_compute_workers          = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] password_length                = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] periodic_enable                = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] periodic_fuzzy_delay           = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] pointer_model                  = ps2mouse {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] preallocate_images             = none {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] publish_errors                 = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] pybasedir                      = /opt/stack/nova {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ram_allocation_ratio           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rate_limit_burst               = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rate_limit_except_level        = CRITICAL {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rate_limit_interval            = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reboot_timeout                 = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reclaim_instance_interval      = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] record                         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reimage_timeout_per_gb         = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] report_interval                = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rescue_timeout                 = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reserved_host_cpus             = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reserved_host_disk_mb          = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reserved_host_memory_mb        = 512 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] reserved_huge_pages            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] resize_confirm_window          = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] resize_fs_using_block_device   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] resume_guests_state_on_host_boot = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rpc_response_timeout           = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] run_external_periodic_tasks    = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] running_deleted_instance_action = reap {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] running_deleted_instance_poll_interval = 1800 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] running_deleted_instance_timeout = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler_instance_sync_interval = 120 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_down_time              = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] servicegroup_driver            = db {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] shelved_offload_time           = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] shelved_poll_interval          = 3600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] shutdown_timeout               = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] source_is_ipv6                 = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ssl_only                       = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] state_path                     = /opt/stack/data/nova {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] sync_power_state_interval      = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] sync_power_state_pool_size     = 1000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] syslog_log_facility            = LOG_USER {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] tempdir                        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] timeout_nbd                    = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] transport_url                  = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] update_resources_interval      = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_cow_images                 = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_eventlog                   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_journal                    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_json                       = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_rootwrap_daemon            = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_stderr                     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] use_syslog                     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vcpu_pin_set                   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plugging_is_fatal          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plugging_timeout           = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] virt_mkfs                      = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] volume_usage_poll_interval     = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] watch_log_file                 = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] web                            = /usr/share/spice-html5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_concurrency.disable_process_locking = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.auth_strategy              = keystone {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.compute_link_prefix        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.dhcp_domain                = novalocal {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.enable_instance_password   = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.glance_link_prefix         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.instance_list_per_project_cells = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.list_records_by_skipping_down_cells = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.local_metadata_per_cell    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.max_limit                  = 1000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.metadata_cache_expiration  = 15 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.neutron_default_tenant_id  = default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.use_forwarded_for          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.use_neutron_default_nets   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_dynamic_targets = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_jsonfile_path   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.backend                  = dogpile.cache.memcached {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.backend_argument         = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.config_prefix            = cache.oslo {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.dead_timeout             = 60.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.debug_cache_backend      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.enable_retry_client      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.enable_socket_keepalive  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.enabled                  = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.expiration_time          = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.hashclient_retry_attempts = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_dead_retry      = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_password        =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_pool_maxsize    = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_sasl_enabled    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.memcache_username        =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.proxies                  = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.retry_attempts           = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.retry_delay              = 0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.socket_keepalive_count   = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.socket_keepalive_idle    = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.socket_keepalive_interval = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.tls_allowed_ciphers      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.tls_cafile               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.tls_certfile             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.tls_enabled              = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cache.tls_keyfile              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.auth_section            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.auth_type               = password {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.cafile                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.certfile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.collect_timing          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.cross_az_attach         = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.debug                   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.endpoint_template       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.http_retries            = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.insecure                = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.keyfile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.os_region_name          = RegionOne {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.split_loggers           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cinder.timeout                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.cpu_dedicated_set      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.cpu_shared_set         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.image_type_exclude_list = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.max_concurrent_disk_ops = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.max_disk_devices_to_attach = -1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.resource_provider_association_refresh = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.shutdown_retry_interval = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] conductor.workers              = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] console.allowed_origins        = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] console.ssl_ciphers            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] console.ssl_minimum_version    = default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] consoleauth.token_ttl          = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.cafile                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.certfile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.collect_timing          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.connect_retries         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.connect_retry_delay     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.endpoint_override       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.insecure                = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.keyfile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.max_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.min_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.region_name             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.service_name            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.service_type            = accelerator {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.split_loggers           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.status_code_retries     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.timeout                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] cyborg.version                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.backend               = sqlalchemy {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.connection            = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.connection_debug      = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.connection_parameters =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.connection_recycle_time = 3600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.connection_trace      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.db_inc_retry_interval = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.db_max_retries        = 20 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.db_max_retry_interval = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.db_retry_interval     = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.max_overflow          = 50 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.max_pool_size         = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.max_retries           = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.mysql_enable_ndb      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.mysql_wsrep_sync_wait = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.pool_timeout          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.retry_interval        = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.slave_connection      = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] database.sqlite_synchronous    = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.backend           = sqlalchemy {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.connection        = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.connection_debug  = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.connection_parameters =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.connection_recycle_time = 3600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.connection_trace  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.db_inc_retry_interval = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.db_max_retries    = 20 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.db_max_retry_interval = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.db_retry_interval = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.max_overflow      = 50 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.max_pool_size     = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.max_retries       = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.mysql_enable_ndb  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.pool_timeout      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.retry_interval    = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.slave_connection  = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] api_database.sqlite_synchronous = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] devices.enabled_mdev_types     = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ephemeral_storage_encryption.enabled = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.api_servers             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.cafile                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.certfile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.collect_timing          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.connect_retries         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.connect_retry_delay     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.debug                   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.default_trusted_certificate_ids = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.enable_certificate_validation = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.enable_rbd_download     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.endpoint_override       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.insecure                = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.keyfile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.max_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.min_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.num_retries             = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.rbd_ceph_conf           =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.rbd_connect_timeout     = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.rbd_pool                =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.rbd_user                =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.region_name             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.service_name            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.service_type            = image {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.split_loggers           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.status_code_retries     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.timeout                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.verify_glance_signatures = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] glance.version                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] guestfs.debug                  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.config_drive_cdrom      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.config_drive_inject_password = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.enable_instance_metrics_collection = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.enable_remotefx         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.instances_path_share    =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.iscsi_initiator_list    = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.limit_cpu_features      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.power_state_check_timeframe = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.use_multipath_io        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.volume_attach_retry_count = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.vswitch_name            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] mks.enabled                    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.manager_interval   = 2400 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.precache_concurrency = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.remove_unused_base_images = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] image_cache.subdirectory_name  = _base {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.api_max_retries         = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.api_retry_interval      = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.auth_section            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.auth_type               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.cafile                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.certfile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.collect_timing          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.connect_retries         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.connect_retry_delay     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.endpoint_override       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.insecure                = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.keyfile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.max_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.min_version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.partition_key           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.peer_list               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.region_name             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.serial_console_state_timeout = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.service_name            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.service_type            = baremetal {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.split_loggers           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.status_code_retries     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.timeout                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ironic.version                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] key_manager.fixed_key          = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.barbican_api_version  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.barbican_endpoint     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.barbican_endpoint_type = public {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.barbican_region_name  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.cafile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.certfile              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.collect_timing        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.insecure              = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.keyfile               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.number_of_retries     = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.retry_delay           = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.send_service_user_token = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.split_loggers         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.timeout               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.verify_ssl            = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican.verify_ssl_path       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.auth_section = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.auth_type = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.cafile   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.certfile = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.collect_timing = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.insecure = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.keyfile  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.split_loggers = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] barbican_service_user.timeout  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.approle_role_id          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.approle_secret_id        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.cafile                   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.certfile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.collect_timing           = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.insecure                 = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.keyfile                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.kv_mountpoint            = secret {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.kv_version               = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.namespace                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.root_token_id            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.split_loggers            = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.ssl_ca_crt_file          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.timeout                  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.use_ssl                  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.cafile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.certfile              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.collect_timing        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.connect_retries       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.connect_retry_delay   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.endpoint_override     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.insecure              = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.keyfile               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.max_version           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.min_version           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.region_name           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.service_name          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.service_type          = identity {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.split_loggers         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.status_code_retries   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.timeout               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] keystone.version               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.connection_uri         =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_mode               = custom {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: WARNING oslo_config.cfg [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_power_governor_high = performance {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_power_governor_low = powersave {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_power_management   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.device_detach_attempts = 8 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.device_detach_timeout  = 20 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.disk_cachemodes        = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.disk_prefix            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.enabled_perf_events    = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.file_backed_memory     = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.gid_maps               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.hw_disk_discard        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.hw_machine_type        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_rbd_glance_store_name =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_rbd_pool        = rbd {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_type            = default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.images_volume_group    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.inject_key             = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.inject_partition       = -2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.inject_password        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.iscsi_iface            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.iser_use_multipath     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_bandwidth = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_downtime = 500 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_inbound_addr = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_permit_post_copy = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_scheme  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_timeout_action = abort {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_tunnelled = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: WARNING oslo_config.cfg [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 27 16:30:08 user nova-compute[71026]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 27 16:30:08 user nova-compute[71026]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 27 16:30:08 user nova-compute[71026]: and ``live_migration_inbound_addr`` respectively.
Jul 27 16:30:08 user nova-compute[71026]: ).  Its value may be silently ignored in the future.
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.live_migration_with_native_tls = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.max_queues             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.nfs_mount_options      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_memory_encrypted_guests = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_pcie_ports         = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.pmem_namespaces        = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.quobyte_client_cfg     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rbd_secret_uuid        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rbd_user               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.remote_filesystem_transport = ssh {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rescue_image_id        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rescue_kernel_id       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rescue_ramdisk_id      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.rx_queue_size          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.smbfs_mount_options    =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.snapshot_compression   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.snapshot_image_format  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.sparse_logical_volumes = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.swtpm_enabled          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.swtpm_group            = tss {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.swtpm_user             = tss {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.sysinfo_serial         = unique {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.tb_cache_size          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.tx_queue_size          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.uid_maps               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.use_virtio_for_bridges = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.virt_type              = kvm {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.volume_clear           = zero {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.volume_clear_size      = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.volume_use_multipath   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_cache_path   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.vzstorage_mount_user   = stack {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.auth_section           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.auth_type              = password {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.cafile                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.certfile               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.collect_timing         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.connect_retries        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.connect_retry_delay    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.default_floating_pool  = public {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.endpoint_override      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.extension_sync_interval = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.http_retries           = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.insecure               = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.keyfile                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.max_version            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.min_version            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.ovs_bridge             = br-int {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.physnets               = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.region_name            = RegionOne {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.service_metadata_proxy = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.service_name           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.service_type           = network {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.split_loggers          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.status_code_retries    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.timeout                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] neutron.version                = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] notifications.bdms_in_notifications = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] notifications.default_level    = INFO {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] notifications.notification_format = unversioned {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] notifications.notify_on_state_change = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] pci.alias                      = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] pci.device_spec                = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] pci.report_in_placement        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.auth_section         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.auth_type            = password {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.cafile               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.certfile             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.collect_timing       = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.connect_retries      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.connect_retry_delay  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.default_domain_id    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.default_domain_name  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.domain_id            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.domain_name          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.endpoint_override    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.insecure             = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.keyfile              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.max_version          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.min_version          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.password             = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.project_domain_id    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.project_domain_name  = Default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.project_id           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.project_name         = service {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.region_name          = RegionOne {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.service_name         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.service_type         = placement {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.split_loggers        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.status_code_retries  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.system_scope         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.timeout              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.trust_id             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.user_domain_id       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.user_domain_name     = Default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.user_id              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.username             = placement {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] placement.version              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.cores                    = 20 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.count_usage_from_placement = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.injected_file_content_bytes = 10240 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.injected_file_path_length = 255 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.injected_files           = 5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.instances                = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.key_pairs                = 100 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.metadata_items           = 128 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.ram                      = 51200 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.recheck_quota            = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.server_group_members     = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] quota.server_groups            = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rdp.enabled                    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.image_metadata_prefilter = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.max_attempts         = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.max_placement_results = 1000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.query_placement_for_availability_zone = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.query_placement_for_image_type_support = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] scheduler.workers              = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.host_subset_size = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.isolated_hosts = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.isolated_images = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.pci_in_placement = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.track_instance_changes = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metrics.required               = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metrics.weight_multiplier      = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] metrics.weight_setting         = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.enabled         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.port_range      = 10000:20000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] serial_console.serialproxy_port = 6083 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.auth_section      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.auth_type         = password {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.cafile            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.certfile          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.collect_timing    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.insecure          = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.keyfile           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.send_service_user_token = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.split_loggers     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] service_user.timeout           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.agent_enabled            = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.enabled                  = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.html5proxy_port          = 6082 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.image_compression        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.jpeg_compression         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.playback_compression     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.server_listen            = 127.0.0.1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.streaming_mode           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] spice.zlib_compression         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] upgrade_levels.baseapi         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] upgrade_levels.cert            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] upgrade_levels.compute         = auto {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] upgrade_levels.conductor       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] upgrade_levels.scheduler       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.auth_section = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.auth_type = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.cafile = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.certfile = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.insecure = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.keyfile = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vendordata_dynamic_auth.timeout = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.api_retry_count         = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.ca_file                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.cache_prefix            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.cluster_name            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.connection_pool_size    = 10 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.console_delay_seconds   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.datastore_regex         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.host_ip                 = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.host_password           = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.host_port               = 443 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.host_username           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.insecure                = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.integration_bridge      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.maximum_objects         = 100 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.pbm_default_policy      = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.pbm_enabled             = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.pbm_wsdl_location       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.serial_port_proxy_uri   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.serial_port_service_uri = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.task_poll_interval      = 0.5 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.use_linked_clone        = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.vnc_keymap              = en-us {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.vnc_port                = 5900 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vmware.vnc_port_total          = 10000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.auth_schemes               = ['none'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.enabled                    = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.novncproxy_port            = 6080 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.server_listen              = 0.0.0.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.vencrypt_ca_certs          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.vencrypt_client_cert       = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vnc.vencrypt_client_key        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.disable_rootwrap   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.enable_numa_live_migration = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.libvirt_disable_apic = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.client_socket_timeout     = 900 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.default_pool_size         = 1000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.keep_alive                = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.max_header_line           = 16384 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.ssl_ca_file               = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.ssl_cert_file             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.ssl_key_file              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.tcp_keepidle              = 600 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] zvm.ca_file                    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] zvm.cloud_connector_url        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] zvm.reachable_timeout          = 300 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.enforce_new_defaults = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.enforce_scope      = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.policy_default_rule = default {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.policy_file        = policy.yaml {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.connection_string     = messaging:// {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.enabled               = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.es_doc_type           = notification {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.es_scroll_size        = 10000 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.es_scroll_time        = 2m {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.filter_error_trace    = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.hmac_keys             = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.sentinel_service_name = mymaster {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.socket_timeout        = 0.1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.trace_requests        = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler.trace_sqlalchemy      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler_jaeger.process_tags   = {} {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler_jaeger.service_name_prefix = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] profiler_otlp.service_name_prefix = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] remote_debug.host              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] remote_debug.port              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_notifications.retry = -1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_messaging_notifications.transport_url = **** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.auth_section        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.auth_type           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.cafile              = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.certfile            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.collect_timing      = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.connect_retries     = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.connect_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.endpoint_id         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.endpoint_override   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.insecure            = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.keyfile             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.max_version         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.min_version         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.region_name         = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.service_name        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.service_type        = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.split_loggers       = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.status_code_retries = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.status_code_retry_delay = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.timeout             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.valid_interfaces    = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_limit.version             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_reports.file_event_handler = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] oslo_reports.log_dir           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.group  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] vif_plug_ovs_privileged.user   = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.flat_interface = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.isolate_vif         = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_vif_ovs.per_port_bridge     = False {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] os_brick.lock_path             = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.capabilities   = [21] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.group          = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.helper_command = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] privsep_osbrick.user           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.group           = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.helper_command  = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] nova_sys_admin.user            = None {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG oslo_service.service [None req-3ff002dc-554b-43fe-8740-c323e18058da None None] ******************************************************************************** {{(pid=71026) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 27 16:30:08 user nova-compute[71026]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Starting native event thread {{(pid=71026) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Starting green dispatch thread {{(pid=71026) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Starting connection event dispatch thread {{(pid=71026) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Connecting to libvirt: qemu:///system {{(pid=71026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f30af2bf820> {{(pid=71026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f30af2bf820> {{(pid=71026) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 27 16:30:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Connection event '1' reason 'None'
Jul 27 16:30:08 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 16:30:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.mount [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Initialising _HostMountState generation 0 {{(pid=71026) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 27 16:30:15 user nova-compute[71026]: INFO nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host capabilities <capabilities>
Jul 27 16:30:15 user nova-compute[71026]:   <host>
Jul 27 16:30:15 user nova-compute[71026]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 27 16:30:15 user nova-compute[71026]:     <cpu>
Jul 27 16:30:15 user nova-compute[71026]:       <arch>x86_64</arch>
Jul 27 16:30:15 user nova-compute[71026]:       <model>IvyBridge-IBRS</model>
Jul 27 16:30:15 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:15 user nova-compute[71026]:       <microcode version='1070'/>
Jul 27 16:30:15 user nova-compute[71026]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 27 16:30:15 user nova-compute[71026]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='ss'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='vmx'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='pcid'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='osxsave'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='hypervisor'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='arat'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='tsc_adjust'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='md-clear'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='stibp'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='arch-capabilities'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='ssbd'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='invtsc'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='rsba'/>
Jul 27 16:30:15 user nova-compute[71026]:       <feature name='skip-l1dfl-vmentry'/>
Jul 27 16:30:15 user nova-compute[71026]:       <pages unit='KiB' size='4'/>
Jul 27 16:30:15 user nova-compute[71026]:       <pages unit='KiB' size='2048'/>
Jul 27 16:30:15 user nova-compute[71026]:     </cpu>
Jul 27 16:30:15 user nova-compute[71026]:     <power_management>
Jul 27 16:30:15 user nova-compute[71026]:       <suspend_mem/>
Jul 27 16:30:15 user nova-compute[71026]:       <suspend_disk/>
Jul 27 16:30:15 user nova-compute[71026]:       <suspend_hybrid/>
Jul 27 16:30:15 user nova-compute[71026]:     </power_management>
Jul 27 16:30:15 user nova-compute[71026]:     <iommu support='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     <migration_features>
Jul 27 16:30:15 user nova-compute[71026]:       <live/>
Jul 27 16:30:15 user nova-compute[71026]:       <uri_transports>
Jul 27 16:30:15 user nova-compute[71026]:         <uri_transport>tcp</uri_transport>
Jul 27 16:30:15 user nova-compute[71026]:         <uri_transport>rdma</uri_transport>
Jul 27 16:30:15 user nova-compute[71026]:       </uri_transports>
Jul 27 16:30:15 user nova-compute[71026]:     </migration_features>
Jul 27 16:30:15 user nova-compute[71026]:     <topology>
Jul 27 16:30:15 user nova-compute[71026]:       <cells num='2'>
Jul 27 16:30:15 user nova-compute[71026]:         <cell id='0'>
Jul 27 16:30:15 user nova-compute[71026]:           <memory unit='KiB'>8189224</memory>
Jul 27 16:30:15 user nova-compute[71026]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 27 16:30:15 user nova-compute[71026]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 16:30:15 user nova-compute[71026]:           <distances>
Jul 27 16:30:15 user nova-compute[71026]:             <sibling id='0' value='10'/>
Jul 27 16:30:15 user nova-compute[71026]:             <sibling id='1' value='20'/>
Jul 27 16:30:15 user nova-compute[71026]:           </distances>
Jul 27 16:30:15 user nova-compute[71026]:           <cpus num='6'>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 27 16:30:15 user nova-compute[71026]:           </cpus>
Jul 27 16:30:15 user nova-compute[71026]:         </cell>
Jul 27 16:30:15 user nova-compute[71026]:         <cell id='1'>
Jul 27 16:30:15 user nova-compute[71026]:           <memory unit='KiB'>8206460</memory>
Jul 27 16:30:15 user nova-compute[71026]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 27 16:30:15 user nova-compute[71026]:           <pages unit='KiB' size='2048'>0</pages>
Jul 27 16:30:15 user nova-compute[71026]:           <distances>
Jul 27 16:30:15 user nova-compute[71026]:             <sibling id='0' value='20'/>
Jul 27 16:30:15 user nova-compute[71026]:             <sibling id='1' value='10'/>
Jul 27 16:30:15 user nova-compute[71026]:           </distances>
Jul 27 16:30:15 user nova-compute[71026]:           <cpus num='6'>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 27 16:30:15 user nova-compute[71026]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 27 16:30:15 user nova-compute[71026]:           </cpus>
Jul 27 16:30:15 user nova-compute[71026]:         </cell>
Jul 27 16:30:15 user nova-compute[71026]:       </cells>
Jul 27 16:30:15 user nova-compute[71026]:     </topology>
Jul 27 16:30:15 user nova-compute[71026]:     <cache>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 27 16:30:15 user nova-compute[71026]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 27 16:30:15 user nova-compute[71026]:     </cache>
Jul 27 16:30:15 user nova-compute[71026]:     <secmodel>
Jul 27 16:30:15 user nova-compute[71026]:       <model>apparmor</model>
Jul 27 16:30:15 user nova-compute[71026]:       <doi>0</doi>
Jul 27 16:30:15 user nova-compute[71026]:     </secmodel>
Jul 27 16:30:15 user nova-compute[71026]:     <secmodel>
Jul 27 16:30:15 user nova-compute[71026]:       <model>dac</model>
Jul 27 16:30:15 user nova-compute[71026]:       <doi>0</doi>
Jul 27 16:30:15 user nova-compute[71026]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 27 16:30:15 user nova-compute[71026]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 27 16:30:15 user nova-compute[71026]:     </secmodel>
Jul 27 16:30:15 user nova-compute[71026]:   </host>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='alpha'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>clipper</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='armv6l'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>spitz</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>nuri</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>kzm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>z2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>tosa</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n810</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>terrier</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>midway</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>microbit</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>verdex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>highbank</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>akita</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>connex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>collie</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='armv7l'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>spitz</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>nuri</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>kzm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>z2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>tosa</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n810</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>terrier</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>midway</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>microbit</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>verdex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>highbank</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>akita</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>connex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>collie</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='aarch64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>integratorcp</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>borzoi</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>spitz</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>nuri</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-b1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatileab</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>kzm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>musca-a</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>smdkc210</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>z2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>tosa</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>sabrelite</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-eb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n810</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>n800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>versatilepb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>terrier</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mainstone</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>midway</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>musicpal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>microbit</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cubieboard</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>verdex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduino2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>raspi3b</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>raspi2b</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>cheetah</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>highbank</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>akita</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>connex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>collie</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>raspi0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <acpi default='on' toggle='yes'/>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='cris'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='i686'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>isapc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>microvm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='kvm'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <pae/>
Jul 27 16:30:15 user nova-compute[71026]:       <nonpae/>
Jul 27 16:30:15 user nova-compute[71026]:       <acpi default='on' toggle='yes'/>
Jul 27 16:30:15 user nova-compute[71026]:       <apic default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='m68k'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>an5206</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>q800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>next-cube</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='microblaze'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='microblazeel'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='mips'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>malta</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='mipsel'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>malta</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='mips64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>malta</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>pica61</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>magnum</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='mips64el'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>malta</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mipssim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>pica61</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>magnum</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='16'>boston</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='ppc'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mac99</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>40p</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>taihu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='ppc64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>taihu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>40p</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mac99</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='ppc64le'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>taihu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ppce500</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>40p</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>pegasos2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>bamboo</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>g3beige</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>mac99</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sam460ex</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>ref405ep</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2048'>powernv8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='riscv32'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='8'>spike</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>opentitan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='8'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='riscv64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='8'>spike</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='5'>sifive_u</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>shakti_c</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sifive_e</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='8'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='s390x'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='sh4'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>shix</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>r2d</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='sh4eb'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>shix</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>r2d</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='sparc'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>SS-5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>SS-20</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>LX</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>SS-4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>SS-10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>Voyager</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='sparc64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sun4u</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>niagara</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>sun4v</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='x86_64'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>64</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>x-remote</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='1'>isapc</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>microvm</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='kvm'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <acpi default='on' toggle='yes'/>
Jul 27 16:30:15 user nova-compute[71026]:       <apic default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='xtensa'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>sim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>kc705</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ml605</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx200</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx60</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]:   <guest>
Jul 27 16:30:15 user nova-compute[71026]:     <os_type>hvm</os_type>
Jul 27 16:30:15 user nova-compute[71026]:     <arch name='xtensaeb'>
Jul 27 16:30:15 user nova-compute[71026]:       <wordsize>32</wordsize>
Jul 27 16:30:15 user nova-compute[71026]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='4'>sim</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>kc705</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ml605</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>virt</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx200</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>lx60</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 27 16:30:15 user nova-compute[71026]:       <domain type='qemu'/>
Jul 27 16:30:15 user nova-compute[71026]:     </arch>
Jul 27 16:30:15 user nova-compute[71026]:     <features>
Jul 27 16:30:15 user nova-compute[71026]:       <cpuselection/>
Jul 27 16:30:15 user nova-compute[71026]:       <deviceboot/>
Jul 27 16:30:15 user nova-compute[71026]:       <disksnapshot default='on' toggle='no'/>
Jul 27 16:30:15 user nova-compute[71026]:     </features>
Jul 27 16:30:15 user nova-compute[71026]:   </guest>
Jul 27 16:30:15 user nova-compute[71026]: </capabilities>
Jul 27 16:30:15 user nova-compute[71026]: 
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-i440fx-6.2</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>i686</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='255'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'/>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='lm'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ide</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-i440fx-jammy</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>i686</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='255'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'/>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='lm'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ide</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-q35-jammy</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>i686</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='288'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'/>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='lm'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-i386</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-q35-6.2</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>i686</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='288'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'/>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='lm'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-i440fx-6.2</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>x86_64</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='255'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>efi</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='invtsc'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='rsba'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ide</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-i440fx-jammy</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>x86_64</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='255'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>efi</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='invtsc'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='rsba'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ide</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-q35-jammy</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>x86_64</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='288'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>efi</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='invtsc'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='rsba'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 27 16:30:16 user nova-compute[71026]: <domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 27 16:30:16 user nova-compute[71026]:   <domain>kvm</domain>
Jul 27 16:30:16 user nova-compute[71026]:   <machine>pc-q35-6.2</machine>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>x86_64</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <vcpu max='288'/>
Jul 27 16:30:16 user nova-compute[71026]:   <iothreads supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:   <os supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='firmware'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>efi</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:     <loader supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>rom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pflash</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='readonly'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='secure'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>yes</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>no</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </loader>
Jul 27 16:30:16 user nova-compute[71026]:   </os>
Jul 27 16:30:16 user nova-compute[71026]:   <cpu>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-passthrough' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='hostPassthroughMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='maximum' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='maximumMigratable'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>on</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>off</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='host-model' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ss'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='vmx'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pcid'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='hypervisor'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arat'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='tsc_adjust'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='umip'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='md-clear'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='arch-capabilities'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='invtsc'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibpb'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='ibrs'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-stibp'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='amd-ssbd'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='rsba'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='require' name='pschange-mc-no'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='erms'/>
Jul 27 16:30:16 user nova-compute[71026]:       <feature policy='disable' name='xsaveopt'/>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:     <mode name='custom' supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>qemu64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>qemu32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>phenom</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>pentium</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>n270</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm64</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>kvm32</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>coreduo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>core2duo</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>athlon</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Westmere</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Snowridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Skylake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>SandyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Penryn</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G5</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G4</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G3</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Opteron_G2</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Opteron_G1</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>IvyBridge</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Icelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Haswell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Rome</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-Milan</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC-IBPB</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>EPYC</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Dhyana</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cooperlake</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>Conroe</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Cascadelake-Server</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-noTSX</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell-IBRS</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='no'>Broadwell</model>
Jul 27 16:30:16 user nova-compute[71026]:       <model usable='yes'>486</model>
Jul 27 16:30:16 user nova-compute[71026]:     </mode>
Jul 27 16:30:16 user nova-compute[71026]:   </cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <memoryBacking supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:     <enum name='sourceType'>
Jul 27 16:30:16 user nova-compute[71026]:       <value>file</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>anonymous</value>
Jul 27 16:30:16 user nova-compute[71026]:       <value>memfd</value>
Jul 27 16:30:16 user nova-compute[71026]:     </enum>
Jul 27 16:30:16 user nova-compute[71026]:   </memoryBacking>
Jul 27 16:30:16 user nova-compute[71026]:   <devices>
Jul 27 16:30:16 user nova-compute[71026]:     <disk supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='diskDevice'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>disk</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cdrom</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>floppy</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>lun</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='bus'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>fdc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sata</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </disk>
Jul 27 16:30:16 user nova-compute[71026]:     <graphics supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='type'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>sdl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vnc</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>spice</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egl-headless</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </graphics>
Jul 27 16:30:16 user nova-compute[71026]:     <video supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='modelType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>cirrus</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>vmvga</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>qxl</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>none</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>bochs</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>ramfb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </video>
Jul 27 16:30:16 user nova-compute[71026]:     <hostdev supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='mode'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>subsystem</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='startupPolicy'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>default</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>mandatory</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>requisite</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>optional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='subsysType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>usb</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>pci</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>scsi</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='capsType'/>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='pciBackend'/>
Jul 27 16:30:16 user nova-compute[71026]:     </hostdev>
Jul 27 16:30:16 user nova-compute[71026]:     <rng supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtio-non-transitional</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>random</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>egd</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>builtin</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </rng>
Jul 27 16:30:16 user nova-compute[71026]:     <filesystem supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='driverType'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>path</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>handle</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>virtiofs</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </filesystem>
Jul 27 16:30:16 user nova-compute[71026]:     <tpm supported='yes'>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='model'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-tis</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>tpm-crb</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:       <enum name='backendModel'>
Jul 27 16:30:16 user nova-compute[71026]:         <value>passthrough</value>
Jul 27 16:30:16 user nova-compute[71026]:         <value>emulator</value>
Jul 27 16:30:16 user nova-compute[71026]:       </enum>
Jul 27 16:30:16 user nova-compute[71026]:     </tpm>
Jul 27 16:30:16 user nova-compute[71026]:   </devices>
Jul 27 16:30:16 user nova-compute[71026]:   <features>
Jul 27 16:30:16 user nova-compute[71026]:     <gic supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:     <vmcoreinfo supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <genid supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backingStoreInput supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <backup supported='yes'/>
Jul 27 16:30:16 user nova-compute[71026]:     <sev supported='no'/>
Jul 27 16:30:16 user nova-compute[71026]:   </features>
Jul 27 16:30:16 user nova-compute[71026]: </domainCapabilities>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71026) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71026) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Checking secure boot support for host arch (x86_64) {{(pid=71026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Checking secure boot support for host arch (x86_64) {{(pid=71026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Checking secure boot support for host arch (x86_64) {{(pid=71026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Checking secure boot support for host arch (x86_64) {{(pid=71026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Checking secure boot support for host arch (x86_64) {{(pid=71026) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Secure Boot support detected
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] cpu compare xml: <cpu match="exact">
Jul 27 16:30:16 user nova-compute[71026]:   <model>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]: </cpu>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.virt.node [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Generated node identity df003a51-b9f8-417e-bcc9-71861af955a8
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.virt.node [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Wrote node identity df003a51-b9f8-417e-bcc9-71861af955a8 to /opt/stack/data/nova/compute_id
Jul 27 16:30:16 user nova-compute[71026]: WARNING nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Compute nodes ['df003a51-b9f8-417e-bcc9-71861af955a8'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 27 16:30:16 user nova-compute[71026]: WARNING nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 27 16:30:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:30:16 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:30:16 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Hypervisor/Node resource view: name=user free_ram=10859MB free_disk=26.481281280517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:30:16 user nova-compute[71026]: WARNING nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] No compute node record for user:df003a51-b9f8-417e-bcc9-71861af955a8: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host df003a51-b9f8-417e-bcc9-71861af955a8 could not be found.
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Compute node record created for user:user with uuid: df003a51-b9f8-417e-bcc9-71861af955a8
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [req-92c0ecfe-c9f5-460c-a73f-ce3dbbecf9f0] Created resource provider record via placement API for resource provider with UUID df003a51-b9f8-417e-bcc9-71861af955a8 and name user.
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71026) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 27 16:30:16 user nova-compute[71026]: INFO nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] kernel doesn't support AMD SEV
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:30:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Libvirt baseline CPU <cpu>
Jul 27 16:30:16 user nova-compute[71026]:   <arch>x86_64</arch>
Jul 27 16:30:16 user nova-compute[71026]:   <model>Nehalem</model>
Jul 27 16:30:16 user nova-compute[71026]:   <vendor>Intel</vendor>
Jul 27 16:30:16 user nova-compute[71026]:   <topology sockets="6" cores="1" threads="1"/>
Jul 27 16:30:16 user nova-compute[71026]: </cpu>
Jul 27 16:30:16 user nova-compute[71026]:  {{(pid=71026) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Updated inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Updating resource provider df003a51-b9f8-417e-bcc9-71861af955a8 generation from 0 to 1 during operation: update_inventory {{(pid=71026) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Updating resource provider df003a51-b9f8-417e-bcc9-71861af955a8 generation from 1 to 2 during operation: update_traits {{(pid=71026) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.643s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.service [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Creating RPC server for service compute {{(pid=71026) start /opt/stack/nova/nova/service.py:182}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.service [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Join ServiceGroup membership for this service compute {{(pid=71026) start /opt/stack/nova/nova/service.py:199}}
Jul 27 16:30:17 user nova-compute[71026]: DEBUG nova.servicegroup.drivers.db [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71026) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 27 16:31:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:31:08 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:31:08 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=10227MB free_disk=26.385257720947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:31:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:32:09 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:32:09 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=10188MB free_disk=26.429855346679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:32:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:32:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:33:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:33:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=10168MB free_disk=26.204254150390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:33:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:33:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:33:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:34:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:34:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=9446MB free_disk=26.226482391357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:34:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:34:13 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:14 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:14 user nova-compute[71026]: INFO nova.compute.claims [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Claim successful on node user
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Creating image(s)
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "/opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "/opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "/opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:15 user nova-compute[71026]: DEBUG nova.policy [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '688ffec95bc74058b2ff385deba277c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33406744ea1f45ff815dd0f9a5278d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.part --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG nova.virt.images [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] 25ab5798-ce67-493f-a351-9c5665bf837e was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.part /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.part /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.converted" returned: 0 in 0.204s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.302s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:16 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp884naqv1/privsep.sock']
Jul 27 16:34:16 user sudo[80154]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp884naqv1/privsep.sock
Jul 27 16:34:16 user sudo[80154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 16:34:17 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Successfully created port: 056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:18 user sudo[80154]: pam_unix(sudo:session): session closed for user root
Jul 27 16:34:18 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Spawned new privsep daemon via rootwrap
Jul 27 16:34:18 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 16:34:18 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 16:34:18 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 27 16:34:18 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80160
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk 1073741824" returned: 0 in 0.052s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Cannot resize image /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lazy-loading 'migration_context' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Ensure instance console log exists: /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:21 user nova-compute[71026]: INFO nova.compute.claims [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Claim successful on node user
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Successfully updated port: 056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquired lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-changed-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Refreshing instance network info cache due to event network-changed-056e2800-044c-458f-98ff-2b1f265bd6f4. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] Acquiring lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Creating image(s)
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.120s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk 1073741824" returned: 0 in 0.042s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.policy [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7cdfafb6ab941ff86123b2f0dba6d77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5c245d5fe404083a2bf9b9f5060d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.125s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updating instance_info_cache with network_info: [{"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Cannot resize image /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'migration_context' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Releasing lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Instance network_info: |[{"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] Acquired lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Refreshing network info cache for port 056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Start _get_guest_xml network_info=[{"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Ensure instance console log exists: /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:22 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:22 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-512513718',display_name='tempest-DeleteServersTestJSON-server-512513718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-512513718',id=1,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33406744ea1f45ff815dd0f9a5278d15',ramdisk_id='',reservation_id='r-ullcmo9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-120381400',owner_user_name='tempest-DeleteServersTestJSON-120381400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:15Z,user_data=None,user_id='688ffec95bc74058b2ff385deba277c5',uuid=cec98ede-1131-4669-9e61-c10b291150f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converting VIF {"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lazy-loading 'pci_devices' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:22 user nova-compute[71026]:   <uuid>cec98ede-1131-4669-9e61-c10b291150f6</uuid>
Jul 27 16:34:22 user nova-compute[71026]:   <name>instance-00000001</name>
Jul 27 16:34:22 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:22 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:22 user nova-compute[71026]:   <metadata>
Jul 27 16:34:22 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:22 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:name>tempest-DeleteServersTestJSON-server-512513718</nova:name>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:22</nova:creationTime>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:22 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:22 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:user uuid="688ffec95bc74058b2ff385deba277c5">tempest-DeleteServersTestJSON-120381400-project-member</nova:user>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:project uuid="33406744ea1f45ff815dd0f9a5278d15">tempest-DeleteServersTestJSON-120381400</nova:project>
Jul 27 16:34:22 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:22 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:22 user nova-compute[71026]:         <nova:port uuid="056e2800-044c-458f-98ff-2b1f265bd6f4">
Jul 27 16:34:22 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 27 16:34:22 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:22 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:22 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:22 user nova-compute[71026]:   </metadata>
Jul 27 16:34:22 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:22 user nova-compute[71026]:     <system>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="serial">cec98ede-1131-4669-9e61-c10b291150f6</entry>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="uuid">cec98ede-1131-4669-9e61-c10b291150f6</entry>
Jul 27 16:34:22 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:22 user nova-compute[71026]:     </system>
Jul 27 16:34:22 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:22 user nova-compute[71026]:   <os>
Jul 27 16:34:22 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:22 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:22 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:22 user nova-compute[71026]:   </os>
Jul 27 16:34:22 user nova-compute[71026]:   <features>
Jul 27 16:34:22 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:22 user nova-compute[71026]:     <apic/>
Jul 27 16:34:22 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:22 user nova-compute[71026]:   </features>
Jul 27 16:34:22 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:22 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:22 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:22 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:22 user nova-compute[71026]:   </clock>
Jul 27 16:34:22 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:22 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:22 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:22 user nova-compute[71026]:   </cpu>
Jul 27 16:34:22 user nova-compute[71026]:   <devices>
Jul 27 16:34:22 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:22 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:22 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk"/>
Jul 27 16:34:22 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:22 user nova-compute[71026]:     </disk>
Jul 27 16:34:22 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:22 user nova-compute[71026]:       <mac address="fa:16:3e:9a:df:62"/>
Jul 27 16:34:22 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:22 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:22 user nova-compute[71026]:       <target dev="tap056e2800-04"/>
Jul 27 16:34:22 user nova-compute[71026]:     </interface>
Jul 27 16:34:22 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:22 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/console.log" append="off"/>
Jul 27 16:34:22 user nova-compute[71026]:     </serial>
Jul 27 16:34:22 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:22 user nova-compute[71026]:     <video>
Jul 27 16:34:22 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:22 user nova-compute[71026]:     </video>
Jul 27 16:34:22 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:22 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:22 user nova-compute[71026]:     </rng>
Jul 27 16:34:22 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:22 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:22 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:22 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:22 user nova-compute[71026]:   </devices>
Jul 27 16:34:22 user nova-compute[71026]: </domain>
Jul 27 16:34:22 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-512513718',display_name='tempest-DeleteServersTestJSON-server-512513718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-512513718',id=1,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33406744ea1f45ff815dd0f9a5278d15',ramdisk_id='',reservation_id='r-ullcmo9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-120381400',owner_user_name='tempest-DeleteServersTestJSON-120381400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:15Z,user_data=None,user_id='688ffec95bc74058b2ff385deba277c5',uuid=cec98ede-1131-4669-9e61-c10b291150f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converting VIF {"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG os_vif [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Created schema index Interface.name {{(pid=71026) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Created schema index Port.name {{(pid=71026) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Created schema index Bridge.name {{(pid=71026) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [POLLOUT] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:22 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpc57c891m/privsep.sock']
Jul 27 16:34:22 user sudo[80207]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpc57c891m/privsep.sock
Jul 27 16:34:22 user sudo[80207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:23 user nova-compute[71026]: INFO nova.compute.claims [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Claim successful on node user
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.141s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:23 user nova-compute[71026]: INFO nova.compute.claims [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Claim successful on node user
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updated VIF entry in instance network info cache for port 056e2800-044c-458f-98ff-2b1f265bd6f4. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updating instance_info_cache with network_info: [{"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0af9c3cc-97ce-4830-8e61-8cb30fe8e1b3 req-0b93f423-c9e1-4df2-a15e-cf4a2d6988d8 service nova] Releasing lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.policy [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421dd87102724509a506e368de55faaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6408faede31045a6a3a34304629caa4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Creating image(s)
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk 1073741824" returned: 0 in 0.060s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Creating image(s)
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "/opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "/opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "/opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user sudo[80207]: pam_unix(sudo:session): session closed for user root
Jul 27 16:34:24 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Spawned new privsep daemon via rootwrap
Jul 27 16:34:24 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 16:34:24 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 16:34:24 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 27 16:34:24 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80217
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.policy [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ce09c32af684da283531bdabc3e15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861424cabfc04dcd801426788ce536d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Cannot resize image /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Ensure instance console log exists: /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk 1073741824" returned: 0 in 0.047s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Successfully created port: 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap056e2800-04, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap056e2800-04, col_values=(('external_ids', {'iface-id': '056e2800-044c-458f-98ff-2b1f265bd6f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:df:62', 'vm-uuid': 'cec98ede-1131-4669-9e61-c10b291150f6'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:25 user nova-compute[71026]: INFO os_vif [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04')
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Cannot resize image /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'migration_context' on Instance uuid 7057a6bb-81b2-42a9-910c-c264a450fa20 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] No VIF found with MAC fa:16:3e:9a:df:62, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Ensure instance console log exists: /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:26 user nova-compute[71026]: INFO nova.compute.claims [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Claim successful on node user
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:26 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:26 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Creating image(s)
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.policy [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421dd87102724509a506e368de55faaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6408faede31045a6a3a34304629caa4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.168s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk 1073741824" returned: 0 in 0.111s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Successfully created port: d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Cannot resize image /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Ensure instance console log exists: /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Successfully created port: 130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Successfully updated port: 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475668.5115514, cec98ede-1131-4669-9e61-c10b291150f6 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] VM Resumed (Lifecycle Event)
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Instance spawned successfully.
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475668.5160267, cec98ede-1131-4669-9e61-c10b291150f6 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] VM Started (Lifecycle Event)
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing instance network info cache due to event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Took 13.23 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:28 user nova-compute[71026]: INFO nova.compute.manager [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Took 14.18 seconds to build instance.
Jul 27 16:34:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c46abf5b-31e7-460f-942f-dc2f588c2dea tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.398s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:29 user nova-compute[71026]: WARNING nova.compute.manager [req-ceab19b3-fe9f-4bcf-9c84-227f86db7c39 req-a1cdf7bd-7ae7-47ff-9cd8-8a433dac751b service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state None.
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance network_info: |[{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start _get_guest_xml network_info=[{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:30 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:30 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1261262759',display_name='tempest-ServerStableDeviceRescueTest-server-1261262759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1261262759',id=2,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLebzHT/ReLmyfHAdUDB+s5h41G6i1UV5+T2SutRBvBUAIHSxj5VOaNMFZJPVUjELdhNWD+XxOHbDEq+7+e0o2WOkTYoaKLr5EuwjT5kTOxp1j39vRQvjDNzn98rHbGmQg==',key_name='tempest-keypair-828655165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef5c245d5fe404083a2bf9b9f5060d0',ramdisk_id='',reservation_id='r-zn2vf2lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1901406311',owner_user_name='tempest-ServerStableDeviceRescueTest-1901406311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7cdfafb6ab941ff86123b2f0dba6d77',uuid=1015a1e1-69ee-42a0-acf9-597323751110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converting VIF {"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'pci_devices' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:30 user nova-compute[71026]:   <uuid>1015a1e1-69ee-42a0-acf9-597323751110</uuid>
Jul 27 16:34:30 user nova-compute[71026]:   <name>instance-00000002</name>
Jul 27 16:34:30 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:30 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:30 user nova-compute[71026]:   <metadata>
Jul 27 16:34:30 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:30 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1261262759</nova:name>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:30</nova:creationTime>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:30 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:30 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:user uuid="d7cdfafb6ab941ff86123b2f0dba6d77">tempest-ServerStableDeviceRescueTest-1901406311-project-member</nova:user>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:project uuid="bef5c245d5fe404083a2bf9b9f5060d0">tempest-ServerStableDeviceRescueTest-1901406311</nova:project>
Jul 27 16:34:30 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:30 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:30 user nova-compute[71026]:         <nova:port uuid="4e3e2fd1-45b3-46ee-85e8-0692ac6994ee">
Jul 27 16:34:30 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:34:30 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:30 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:30 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:30 user nova-compute[71026]:   </metadata>
Jul 27 16:34:30 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:30 user nova-compute[71026]:     <system>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="serial">1015a1e1-69ee-42a0-acf9-597323751110</entry>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="uuid">1015a1e1-69ee-42a0-acf9-597323751110</entry>
Jul 27 16:34:30 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:30 user nova-compute[71026]:     </system>
Jul 27 16:34:30 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:30 user nova-compute[71026]:   <os>
Jul 27 16:34:30 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:30 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:30 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:30 user nova-compute[71026]:   </os>
Jul 27 16:34:30 user nova-compute[71026]:   <features>
Jul 27 16:34:30 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:30 user nova-compute[71026]:     <apic/>
Jul 27 16:34:30 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:30 user nova-compute[71026]:   </features>
Jul 27 16:34:30 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:30 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:30 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:30 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:30 user nova-compute[71026]:   </clock>
Jul 27 16:34:30 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:30 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:30 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:30 user nova-compute[71026]:   </cpu>
Jul 27 16:34:30 user nova-compute[71026]:   <devices>
Jul 27 16:34:30 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:30 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:30 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk"/>
Jul 27 16:34:30 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:30 user nova-compute[71026]:     </disk>
Jul 27 16:34:30 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:30 user nova-compute[71026]:       <mac address="fa:16:3e:15:10:68"/>
Jul 27 16:34:30 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:30 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:30 user nova-compute[71026]:       <target dev="tap4e3e2fd1-45"/>
Jul 27 16:34:30 user nova-compute[71026]:     </interface>
Jul 27 16:34:30 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:30 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/console.log" append="off"/>
Jul 27 16:34:30 user nova-compute[71026]:     </serial>
Jul 27 16:34:30 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:30 user nova-compute[71026]:     <video>
Jul 27 16:34:30 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:30 user nova-compute[71026]:     </video>
Jul 27 16:34:30 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:30 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:30 user nova-compute[71026]:     </rng>
Jul 27 16:34:30 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:30 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:30 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:30 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:30 user nova-compute[71026]:   </devices>
Jul 27 16:34:30 user nova-compute[71026]: </domain>
Jul 27 16:34:30 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1261262759',display_name='tempest-ServerStableDeviceRescueTest-server-1261262759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1261262759',id=2,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLebzHT/ReLmyfHAdUDB+s5h41G6i1UV5+T2SutRBvBUAIHSxj5VOaNMFZJPVUjELdhNWD+XxOHbDEq+7+e0o2WOkTYoaKLr5EuwjT5kTOxp1j39vRQvjDNzn98rHbGmQg==',key_name='tempest-keypair-828655165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bef5c245d5fe404083a2bf9b9f5060d0',ramdisk_id='',reservation_id='r-zn2vf2lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1901406311',owner_user_name='tempest-ServerStableDeviceRescueTest-1901406311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7cdfafb6ab941ff86123b2f0dba6d77',uuid=1015a1e1-69ee-42a0-acf9-597323751110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converting VIF {"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG os_vif [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e3e2fd1-45, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e3e2fd1-45, col_values=(('external_ids', {'iface-id': '4e3e2fd1-45b3-46ee-85e8-0692ac6994ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:10:68', 'vm-uuid': '1015a1e1-69ee-42a0-acf9-597323751110'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:30 user nova-compute[71026]: INFO os_vif [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45')
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Successfully created port: e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Successfully updated port: d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-changed-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Refreshing instance network info cache due to event network-changed-d401c2c4-92ad-4060-a4bd-157e7ca89ef2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Refreshing network info cache for port d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No VIF found with MAC fa:16:3e:15:10:68, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Successfully updated port: 130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:31 user nova-compute[71026]: INFO nova.compute.claims [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Claim successful on node user
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquired lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.network.neutron [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09dddd9c-2231-4322-aa78-acf43872e05d req-4e7ce7e7-1ccd-4b95-8500-603b6464960d service nova] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:32 user nova-compute[71026]: WARNING nova.compute.manager [req-562de5a5-0034-4f63-b788-a77f48dca211 req-6f932215-8fc6-482d-af11-3099ce43ba1f service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state None.
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.policy [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145d143ed66e4ddd9708b36e6ddeeb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff31b3d25a99410aab34dff6c445ff44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Creating image(s)
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-changed-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Refreshing instance network info cache due to event network-changed-130ef235-341f-4565-8f12-e7b5e644fae3. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] Acquiring lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updated VIF entry in instance network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-581407a4-1f96-49ca-aa3a-ba540d0d02fa req-e453581f-4086-419f-b804-9a6661a63483 service nova] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.191s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updating instance_info_cache with network_info: [{"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Releasing lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Instance network_info: |[{"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] Acquired lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Refreshing network info cache for port 130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Start _get_guest_xml network_info=[{"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:32 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:32 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1378519878',display_name='tempest-ServersNegativeTestJSON-server-1378519878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1378519878',id=4,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-z00xcx1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:25Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=7057a6bb-81b2-42a9-910c-c264a450fa20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:32 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'pci_devices' on Instance uuid 7057a6bb-81b2-42a9-910c-c264a450fa20 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk 1073741824" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:33 user nova-compute[71026]:   <uuid>7057a6bb-81b2-42a9-910c-c264a450fa20</uuid>
Jul 27 16:34:33 user nova-compute[71026]:   <name>instance-00000004</name>
Jul 27 16:34:33 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:33 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:33 user nova-compute[71026]:   <metadata>
Jul 27 16:34:33 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:33 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:name>tempest-ServersNegativeTestJSON-server-1378519878</nova:name>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:32</nova:creationTime>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:33 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:user uuid="0ce09c32af684da283531bdabc3e15a7">tempest-ServersNegativeTestJSON-1653924088-project-member</nova:user>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:project uuid="861424cabfc04dcd801426788ce536d3">tempest-ServersNegativeTestJSON-1653924088</nova:project>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:port uuid="130ef235-341f-4565-8f12-e7b5e644fae3">
Jul 27 16:34:33 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:34:33 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:33 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:33 user nova-compute[71026]:   </metadata>
Jul 27 16:34:33 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:33 user nova-compute[71026]:     <system>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="serial">7057a6bb-81b2-42a9-910c-c264a450fa20</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="uuid">7057a6bb-81b2-42a9-910c-c264a450fa20</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:33 user nova-compute[71026]:     </system>
Jul 27 16:34:33 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:33 user nova-compute[71026]:   <os>
Jul 27 16:34:33 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:33 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:33 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:33 user nova-compute[71026]:   </os>
Jul 27 16:34:33 user nova-compute[71026]:   <features>
Jul 27 16:34:33 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:33 user nova-compute[71026]:     <apic/>
Jul 27 16:34:33 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:33 user nova-compute[71026]:   </features>
Jul 27 16:34:33 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:33 user nova-compute[71026]:   </clock>
Jul 27 16:34:33 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:33 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:33 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:33 user nova-compute[71026]:   </cpu>
Jul 27 16:34:33 user nova-compute[71026]:   <devices>
Jul 27 16:34:33 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:33 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:33 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk"/>
Jul 27 16:34:33 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:     </disk>
Jul 27 16:34:33 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:33 user nova-compute[71026]:       <mac address="fa:16:3e:6e:10:df"/>
Jul 27 16:34:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:33 user nova-compute[71026]:       <target dev="tap130ef235-34"/>
Jul 27 16:34:33 user nova-compute[71026]:     </interface>
Jul 27 16:34:33 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:33 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/console.log" append="off"/>
Jul 27 16:34:33 user nova-compute[71026]:     </serial>
Jul 27 16:34:33 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:33 user nova-compute[71026]:     <video>
Jul 27 16:34:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:     </video>
Jul 27 16:34:33 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:33 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:33 user nova-compute[71026]:     </rng>
Jul 27 16:34:33 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:33 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:33 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:33 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:33 user nova-compute[71026]:   </devices>
Jul 27 16:34:33 user nova-compute[71026]: </domain>
Jul 27 16:34:33 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1378519878',display_name='tempest-ServersNegativeTestJSON-server-1378519878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1378519878',id=4,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-z00xcx1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:25Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=7057a6bb-81b2-42a9-910c-c264a450fa20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG os_vif [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap130ef235-34, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap130ef235-34, col_values=(('external_ids', {'iface-id': '130ef235-341f-4565-8f12-e7b5e644fae3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:10:df', 'vm-uuid': '7057a6bb-81b2-42a9-910c-c264a450fa20'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: INFO os_vif [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34')
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] No VIF found with MAC fa:16:3e:6e:10:df, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Cannot resize image /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'migration_context' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Ensure instance console log exists: /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance network_info: |[{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start _get_guest_xml network_info=[{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323839499',display_name='tempest-ServerRescueNegativeTestJSON-server-1323839499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323839499',id=3,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-dr4vxw0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:24Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=b991c2a5-894c-49e7-896c-69eb95eb84bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:33 user nova-compute[71026]:   <uuid>b991c2a5-894c-49e7-896c-69eb95eb84bd</uuid>
Jul 27 16:34:33 user nova-compute[71026]:   <name>instance-00000003</name>
Jul 27 16:34:33 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:33 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:33 user nova-compute[71026]:   <metadata>
Jul 27 16:34:33 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:33 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1323839499</nova:name>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:33</nova:creationTime>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:33 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:33 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:33 user nova-compute[71026]:         <nova:port uuid="d401c2c4-92ad-4060-a4bd-157e7ca89ef2">
Jul 27 16:34:33 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:34:33 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:33 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:33 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:33 user nova-compute[71026]:   </metadata>
Jul 27 16:34:33 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:33 user nova-compute[71026]:     <system>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="serial">b991c2a5-894c-49e7-896c-69eb95eb84bd</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="uuid">b991c2a5-894c-49e7-896c-69eb95eb84bd</entry>
Jul 27 16:34:33 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:33 user nova-compute[71026]:     </system>
Jul 27 16:34:33 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:33 user nova-compute[71026]:   <os>
Jul 27 16:34:33 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:33 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:33 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:33 user nova-compute[71026]:   </os>
Jul 27 16:34:33 user nova-compute[71026]:   <features>
Jul 27 16:34:33 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:33 user nova-compute[71026]:     <apic/>
Jul 27 16:34:33 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:33 user nova-compute[71026]:   </features>
Jul 27 16:34:33 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:33 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:33 user nova-compute[71026]:   </clock>
Jul 27 16:34:33 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:33 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:33 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:33 user nova-compute[71026]:   </cpu>
Jul 27 16:34:33 user nova-compute[71026]:   <devices>
Jul 27 16:34:33 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:33 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:33 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk"/>
Jul 27 16:34:33 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:     </disk>
Jul 27 16:34:33 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:33 user nova-compute[71026]:       <mac address="fa:16:3e:db:d9:0c"/>
Jul 27 16:34:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:33 user nova-compute[71026]:       <target dev="tapd401c2c4-92"/>
Jul 27 16:34:33 user nova-compute[71026]:     </interface>
Jul 27 16:34:33 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:33 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/console.log" append="off"/>
Jul 27 16:34:33 user nova-compute[71026]:     </serial>
Jul 27 16:34:33 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:33 user nova-compute[71026]:     <video>
Jul 27 16:34:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:33 user nova-compute[71026]:     </video>
Jul 27 16:34:33 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:33 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:33 user nova-compute[71026]:     </rng>
Jul 27 16:34:33 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:33 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:33 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:33 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:33 user nova-compute[71026]:   </devices>
Jul 27 16:34:33 user nova-compute[71026]: </domain>
Jul 27 16:34:33 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323839499',display_name='tempest-ServerRescueNegativeTestJSON-server-1323839499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323839499',id=3,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-dr4vxw0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:24Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=b991c2a5-894c-49e7-896c-69eb95eb84bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG os_vif [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd401c2c4-92, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd401c2c4-92, col_values=(('external_ids', {'iface-id': 'd401c2c4-92ad-4060-a4bd-157e7ca89ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:d9:0c', 'vm-uuid': 'b991c2a5-894c-49e7-896c-69eb95eb84bd'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:33 user nova-compute[71026]: INFO os_vif [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92')
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:db:d9:0c, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:34 user nova-compute[71026]: WARNING nova.compute.manager [req-cbab4a68-fcd6-4966-b556-ea090a90fc72 req-4d9295fb-70e6-49d9-8448-a447f13b4f4a service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state building and task_state spawning.
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Successfully updated port: e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updated VIF entry in instance network info cache for port 130ef235-341f-4565-8f12-e7b5e644fae3. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updating instance_info_cache with network_info: [{"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-772ef5a7-79f8-4b91-9421-42b1b1244c46 req-120a382b-20eb-4dd9-89e6-02f99a86ca43 service nova] Releasing lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-changed-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Refreshing instance network info cache due to event network-changed-e03a7098-b905-4b6b-8f2f-9eb80afc928d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475675.1644151, 1015a1e1-69ee-42a0-acf9-597323751110 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Resumed (Lifecycle Event)
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance spawned successfully.
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475675.1659842, 1015a1e1-69ee-42a0-acf9-597323751110 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Started (Lifecycle Event)
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Successfully created port: dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Took 13.46 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:35 user nova-compute[71026]: INFO nova.compute.manager [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Took 14.44 seconds to build instance.
Jul 27 16:34:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4bcf6d9f-ce7c-4275-8696-afcf727d7fe6 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.560s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance network_info: |[{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Refreshing network info cache for port e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start _get_guest_xml network_info=[{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-367530359',display_name='tempest-ServerRescueNegativeTestJSON-server-367530359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-367530359',id=5,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-nug1sdfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:27Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=d6e2b6dc-8408-4f7d-8286-68fd01ef25c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:36 user nova-compute[71026]:   <uuid>d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</uuid>
Jul 27 16:34:36 user nova-compute[71026]:   <name>instance-00000005</name>
Jul 27 16:34:36 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:36 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:36 user nova-compute[71026]:   <metadata>
Jul 27 16:34:36 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:36 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-367530359</nova:name>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:36</nova:creationTime>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:36 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:36 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:34:36 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:36 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:36 user nova-compute[71026]:         <nova:port uuid="e03a7098-b905-4b6b-8f2f-9eb80afc928d">
Jul 27 16:34:36 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:34:36 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:36 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:36 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:36 user nova-compute[71026]:   </metadata>
Jul 27 16:34:36 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:36 user nova-compute[71026]:     <system>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="serial">d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</entry>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="uuid">d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</entry>
Jul 27 16:34:36 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:36 user nova-compute[71026]:     </system>
Jul 27 16:34:36 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:36 user nova-compute[71026]:   <os>
Jul 27 16:34:36 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:36 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:36 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:36 user nova-compute[71026]:   </os>
Jul 27 16:34:36 user nova-compute[71026]:   <features>
Jul 27 16:34:36 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:36 user nova-compute[71026]:     <apic/>
Jul 27 16:34:36 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:36 user nova-compute[71026]:   </features>
Jul 27 16:34:36 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:36 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:36 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:36 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:36 user nova-compute[71026]:   </clock>
Jul 27 16:34:36 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:36 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:36 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:36 user nova-compute[71026]:   </cpu>
Jul 27 16:34:36 user nova-compute[71026]:   <devices>
Jul 27 16:34:36 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:36 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:36 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk"/>
Jul 27 16:34:36 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:36 user nova-compute[71026]:     </disk>
Jul 27 16:34:36 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:36 user nova-compute[71026]:       <mac address="fa:16:3e:21:2e:1c"/>
Jul 27 16:34:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:36 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:36 user nova-compute[71026]:       <target dev="tape03a7098-b9"/>
Jul 27 16:34:36 user nova-compute[71026]:     </interface>
Jul 27 16:34:36 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:36 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/console.log" append="off"/>
Jul 27 16:34:36 user nova-compute[71026]:     </serial>
Jul 27 16:34:36 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:36 user nova-compute[71026]:     <video>
Jul 27 16:34:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:36 user nova-compute[71026]:     </video>
Jul 27 16:34:36 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:36 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:36 user nova-compute[71026]:     </rng>
Jul 27 16:34:36 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:36 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:36 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:36 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:36 user nova-compute[71026]:   </devices>
Jul 27 16:34:36 user nova-compute[71026]: </domain>
Jul 27 16:34:36 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-367530359',display_name='tempest-ServerRescueNegativeTestJSON-server-367530359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-367530359',id=5,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-nug1sdfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:27Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=d6e2b6dc-8408-4f7d-8286-68fd01ef25c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG os_vif [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape03a7098-b9, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape03a7098-b9, col_values=(('external_ids', {'iface-id': 'e03a7098-b905-4b6b-8f2f-9eb80afc928d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:2e:1c', 'vm-uuid': 'd6e2b6dc-8408-4f7d-8286-68fd01ef25c6'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: INFO os_vif [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9')
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:21:2e:1c, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:36 user nova-compute[71026]: WARNING nova.compute.manager [req-603c1616-8ae8-4e7f-a2d9-337b8e2a1350 req-9d6d675c-0c5e-46f6-b8d5-dd63be04af4b service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state None.
Jul 27 16:34:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] No waiting events found dispatching network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:37 user nova-compute[71026]: WARNING nova.compute.manager [req-f9380ce6-c648-4f27-a23f-f309213fea7b req-03cad2b5-34ca-4185-9124-55ab56cc5ea8 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received unexpected event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 for instance with vm_state building and task_state spawning.
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:38 user nova-compute[71026]: WARNING nova.compute.manager [req-1888b3f4-4836-4a91-ac0d-2a4557a4f566 req-fe6a7cdb-91b3-4927-998c-a09c410a715a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state building and task_state spawning.
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] No waiting events found dispatching network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:39 user nova-compute[71026]: WARNING nova.compute.manager [req-e680b411-7ada-4208-b695-d877bd232d96 req-88f1d7ba-73d5-4ddd-92da-86eaed8eaab2 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received unexpected event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 for instance with vm_state building and task_state spawning.
Jul 27 16:34:39 user nova-compute[71026]: DEBUG nova.network.neutron [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updated VIF entry in instance network info cache for port e03a7098-b905-4b6b-8f2f-9eb80afc928d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG nova.network.neutron [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6d34786b-a791-47d4-a9dc-b5202edcd021 req-1216e5b8-da52-4979-9313-4f0b31f2c231 service nova] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Successfully updated port: dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-changed-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Refreshing instance network info cache due to event network-changed-dbd736b7-dabf-4687-845b-afd30024718d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:41 user nova-compute[71026]: WARNING nova.compute.manager [req-301264ac-83f5-4ed4-9f95-1d3575f82289 req-9587fcb8-4f48-4ebe-822c-e4e39791841c service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state building and task_state spawning.
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance network_info: |[{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.network.neutron [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Refreshing network info cache for port dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start _get_guest_xml network_info=[{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:41 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:41 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'pci_devices' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:42 user nova-compute[71026]: WARNING nova.compute.manager [req-23442e8d-45f9-4aab-a2ce-e37302a2e4e6 req-ffcf9392-5743-417f-b5d9-72aa423524b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state building and task_state spawning.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:42 user nova-compute[71026]:   <uuid>790cd259-4d88-427a-acf4-d4d70c9fc8d1</uuid>
Jul 27 16:34:42 user nova-compute[71026]:   <name>instance-00000006</name>
Jul 27 16:34:42 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:42 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:42 user nova-compute[71026]:   <metadata>
Jul 27 16:34:42 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:42 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherB-server-1556874473</nova:name>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:41</nova:creationTime>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:42 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:42 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:user uuid="145d143ed66e4ddd9708b36e6ddeeb09">tempest-ServerActionsTestOtherB-496611114-project-member</nova:user>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:project uuid="ff31b3d25a99410aab34dff6c445ff44">tempest-ServerActionsTestOtherB-496611114</nova:project>
Jul 27 16:34:42 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:34:42 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:42 user nova-compute[71026]:         <nova:port uuid="dbd736b7-dabf-4687-845b-afd30024718d">
Jul 27 16:34:42 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:34:42 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:42 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:42 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:42 user nova-compute[71026]:   </metadata>
Jul 27 16:34:42 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:42 user nova-compute[71026]:     <system>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="serial">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="uuid">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:34:42 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:42 user nova-compute[71026]:     </system>
Jul 27 16:34:42 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:42 user nova-compute[71026]:   <os>
Jul 27 16:34:42 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:42 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:42 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:42 user nova-compute[71026]:   </os>
Jul 27 16:34:42 user nova-compute[71026]:   <features>
Jul 27 16:34:42 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:42 user nova-compute[71026]:     <apic/>
Jul 27 16:34:42 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:42 user nova-compute[71026]:   </features>
Jul 27 16:34:42 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:42 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:42 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:42 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:42 user nova-compute[71026]:   </clock>
Jul 27 16:34:42 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:42 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:42 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:42 user nova-compute[71026]:   </cpu>
Jul 27 16:34:42 user nova-compute[71026]:   <devices>
Jul 27 16:34:42 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:42 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:42 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk"/>
Jul 27 16:34:42 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:34:42 user nova-compute[71026]:     </disk>
Jul 27 16:34:42 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:42 user nova-compute[71026]:       <mac address="fa:16:3e:cb:e0:30"/>
Jul 27 16:34:42 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:42 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:42 user nova-compute[71026]:       <target dev="tapdbd736b7-da"/>
Jul 27 16:34:42 user nova-compute[71026]:     </interface>
Jul 27 16:34:42 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:42 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/console.log" append="off"/>
Jul 27 16:34:42 user nova-compute[71026]:     </serial>
Jul 27 16:34:42 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:42 user nova-compute[71026]:     <video>
Jul 27 16:34:42 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:42 user nova-compute[71026]:     </video>
Jul 27 16:34:42 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:42 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:42 user nova-compute[71026]:     </rng>
Jul 27 16:34:42 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:42 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:42 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:42 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:42 user nova-compute[71026]:   </devices>
Jul 27 16:34:42 user nova-compute[71026]: </domain>
Jul 27 16:34:42 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG os_vif [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd736b7-da, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbd736b7-da, col_values=(('external_ids', {'iface-id': 'dbd736b7-dabf-4687-845b-afd30024718d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e0:30', 'vm-uuid': '790cd259-4d88-427a-acf4-d4d70c9fc8d1'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: INFO os_vif [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No VIF found with MAC fa:16:3e:cb:e0:30, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.298325, 7057a6bb-81b2-42a9-910c-c264a450fa20 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] VM Resumed (Lifecycle Event)
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Instance spawned successfully.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.2991238, 7057a6bb-81b2-42a9-910c-c264a450fa20 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] VM Started (Lifecycle Event)
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Took 17.69 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.6637745, b991c2a5-894c-49e7-896c-69eb95eb84bd => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Resumed (Lifecycle Event)
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Took 18.97 seconds to build instance.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance spawned successfully.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance spawned successfully.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fd338a76-2134-4e7f-8ac4-0d4365b805e3 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.154s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.6691265, b991c2a5-894c-49e7-896c-69eb95eb84bd => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Started (Lifecycle Event)
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.6710818, d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] VM Resumed (Lifecycle Event)
Jul 27 16:34:42 user nova-compute[71026]: INFO nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Took 18.59 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475682.6727452, d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] VM Started (Lifecycle Event)
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Took 16.49 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Took 19.71 seconds to build instance.
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9afb6a3d-873d-4351-b416-4a55f6d33b37 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.916s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:43 user nova-compute[71026]: INFO nova.compute.manager [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Took 17.48 seconds to build instance.
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updated VIF entry in instance network info cache for port dbd736b7-dabf-4687-845b-afd30024718d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c14ef0a0-c252-44a2-8260-f631998f2dee tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.745s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e525829e-5255-4516-a67d-61cab97ecb30 req-ebedc565-1ea7-4d5f-bbb5-b6b846c9c7f7 service nova] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:44 user nova-compute[71026]: WARNING nova.compute.manager [req-b01869ea-ef3b-4fdd-82c3-e867d083ff4b req-97839032-6d2b-4e44-a112-51cb4f606e2c service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state active and task_state None.
Jul 27 16:34:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:46 user nova-compute[71026]: WARNING nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state building and task_state spawning.
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:34:46 user nova-compute[71026]: WARNING nova.compute.manager [req-07d8060c-6262-4361-9398-4f917efad039 req-e90ea5fd-fd60-4f4c-a8d3-824ff4641670 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state building and task_state spawning.
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475686.987572, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:46 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Resumed (Lifecycle Event)
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:34:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance spawned successfully.
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475686.9933093, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Started (Lifecycle Event)
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Took 14.94 seconds to spawn the instance on the hypervisor.
Jul 27 16:34:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:34:47 user nova-compute[71026]: INFO nova.compute.manager [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Took 16.43 seconds to build instance.
Jul 27 16:34:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d4fc43f-15b2-45f9-ab54-e8c7e5e269b2 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.615s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:54 user nova-compute[71026]: INFO nova.compute.claims [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Claim successful on node user
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.501s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:34:54 user nova-compute[71026]: INFO nova.compute.claims [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Claim successful on node user
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.policy [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9a3f1bcf2a2451cba737f9a1ba47a3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '494af5d25e76404bad17a4a968463dfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Creating image(s)
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.part --force-share --output=json" returned: 0 in 0.183s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.virt.images [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] ee293e36-8afd-41d3-9bcf-e3a98a54b121 was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.part /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.170s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:34:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.part /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.converted" returned: 0 in 0.300s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.policy [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789e9b39aef14ae4af5a48148b92994d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c84998d34fb49cb9cb17eb2b4353201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Successfully created port: cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:34:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Creating image(s)
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "/opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "/opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "/opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc.converted --force-share --output=json" returned: 0 in 0.283s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.364s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.202s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json" returned: 0 in 0.209s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.192s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc,backing_fmt=raw /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk 1073741824" returned: 0 in 0.107s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc,backing_fmt=raw /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk 1073741824" returned: 0 in 0.097s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "56b60ef71181e8544d0591e3429fac84fb7b09fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.244s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc --force-share --output=json" returned: 0 in 0.237s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Cannot resize image /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'migration_context' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Cannot resize image /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'migration_context' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Ensure instance console log exists: /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Ensure instance console log exists: /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Successfully created port: d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Successfully updated port: cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquired lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-changed-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Refreshing instance network info cache due to event network-changed-cc879d42-a438-41cb-9396-68694bf1c160. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] Acquiring lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating instance_info_cache with network_info: [{"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Releasing lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Instance network_info: |[{"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] Acquired lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Refreshing network info cache for port cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Start _get_guest_xml network_info=[{"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:34:44Z,direct_url=<?>,disk_format='qcow2',id=ee293e36-8afd-41d3-9bcf-e3a98a54b121,min_disk=0,min_ram=0,name='',owner='262d3dceaeb64f1f9f845d4300791dbe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:34:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'size': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'ee293e36-8afd-41d3-9bcf-e3a98a54b121'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:34:44Z,direct_url=<?>,disk_format='qcow2',id=ee293e36-8afd-41d3-9bcf-e3a98a54b121,min_disk=0,min_ram=0,name='',owner='262d3dceaeb64f1f9f845d4300791dbe',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:34:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-199503615',display_name='tempest-AttachSCSIVolumeTestJSON-server-199503615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-199503615',id=7,image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/dlbiJbuKgyrsb8U3dpAD75aIbVSwTJs75OmR+LMNIDX+dKF9yjW4J+OnhzRPSy2Mt3UzJsQe6+TUXw731YpagDG9wW4UyQG+C9Zz0zJ/sLYOgjnh6al85v4iYN0M44A==',key_name='tempest-keypair-1858432515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='494af5d25e76404bad17a4a968463dfe',ramdisk_id='',reservation_id='r-md5o40iy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1537037127',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1537037127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9a3f1bcf2a2451cba737f9a1ba47a3e',uuid=3d7e58a9-6acf-4584-bb38-1d88d536ed63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converting VIF {"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:34:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:34:58 user nova-compute[71026]:   <uuid>3d7e58a9-6acf-4584-bb38-1d88d536ed63</uuid>
Jul 27 16:34:58 user nova-compute[71026]:   <name>instance-00000007</name>
Jul 27 16:34:58 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:34:58 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:34:58 user nova-compute[71026]:   <metadata>
Jul 27 16:34:58 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:34:58 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-199503615</nova:name>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:58</nova:creationTime>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:34:58 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:34:58 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:owner>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:user uuid="a9a3f1bcf2a2451cba737f9a1ba47a3e">tempest-AttachSCSIVolumeTestJSON-1537037127-project-member</nova:user>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:project uuid="494af5d25e76404bad17a4a968463dfe">tempest-AttachSCSIVolumeTestJSON-1537037127</nova:project>
Jul 27 16:34:58 user nova-compute[71026]:       </nova:owner>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:root type="image" uuid="ee293e36-8afd-41d3-9bcf-e3a98a54b121"/>
Jul 27 16:34:58 user nova-compute[71026]:       <nova:ports>
Jul 27 16:34:58 user nova-compute[71026]:         <nova:port uuid="cc879d42-a438-41cb-9396-68694bf1c160">
Jul 27 16:34:58 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:34:58 user nova-compute[71026]:         </nova:port>
Jul 27 16:34:58 user nova-compute[71026]:       </nova:ports>
Jul 27 16:34:58 user nova-compute[71026]:     </nova:instance>
Jul 27 16:34:58 user nova-compute[71026]:   </metadata>
Jul 27 16:34:58 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:34:58 user nova-compute[71026]:     <system>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="serial">3d7e58a9-6acf-4584-bb38-1d88d536ed63</entry>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="uuid">3d7e58a9-6acf-4584-bb38-1d88d536ed63</entry>
Jul 27 16:34:58 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:34:58 user nova-compute[71026]:     </system>
Jul 27 16:34:58 user nova-compute[71026]:   </sysinfo>
Jul 27 16:34:58 user nova-compute[71026]:   <os>
Jul 27 16:34:58 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:34:58 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:34:58 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:34:58 user nova-compute[71026]:   </os>
Jul 27 16:34:58 user nova-compute[71026]:   <features>
Jul 27 16:34:58 user nova-compute[71026]:     <acpi/>
Jul 27 16:34:58 user nova-compute[71026]:     <apic/>
Jul 27 16:34:58 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:34:58 user nova-compute[71026]:   </features>
Jul 27 16:34:58 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:34:58 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:34:58 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:34:58 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:34:58 user nova-compute[71026]:   </clock>
Jul 27 16:34:58 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:34:58 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:34:58 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:34:58 user nova-compute[71026]:   </cpu>
Jul 27 16:34:58 user nova-compute[71026]:   <devices>
Jul 27 16:34:58 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:34:58 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:34:58 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk"/>
Jul 27 16:34:58 user nova-compute[71026]:       <target dev="sda" bus="scsi"/>
Jul 27 16:34:58 user nova-compute[71026]:       <address type="drive" controller="0" unit="0"/>
Jul 27 16:34:58 user nova-compute[71026]:     </disk>
Jul 27 16:34:58 user nova-compute[71026]:     <disk type="file" device="cdrom">
Jul 27 16:34:58 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 16:34:58 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.config"/>
Jul 27 16:34:58 user nova-compute[71026]:       <target dev="sdb" bus="scsi"/>
Jul 27 16:34:58 user nova-compute[71026]:       <address type="drive" controller="0" unit="1"/>
Jul 27 16:34:58 user nova-compute[71026]:     </disk>
Jul 27 16:34:58 user nova-compute[71026]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 27 16:34:58 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:34:58 user nova-compute[71026]:       <mac address="fa:16:3e:43:a4:24"/>
Jul 27 16:34:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:58 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:34:58 user nova-compute[71026]:       <target dev="tapcc879d42-a4"/>
Jul 27 16:34:58 user nova-compute[71026]:     </interface>
Jul 27 16:34:58 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:34:58 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/console.log" append="off"/>
Jul 27 16:34:58 user nova-compute[71026]:     </serial>
Jul 27 16:34:58 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:34:58 user nova-compute[71026]:     <video>
Jul 27 16:34:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:34:58 user nova-compute[71026]:     </video>
Jul 27 16:34:58 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:34:58 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:34:58 user nova-compute[71026]:     </rng>
Jul 27 16:34:58 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:34:58 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:34:58 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:34:58 user nova-compute[71026]:     </memballoon>
Jul 27 16:34:58 user nova-compute[71026]:   </devices>
Jul 27 16:34:58 user nova-compute[71026]: </domain>
Jul 27 16:34:58 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-199503615',display_name='tempest-AttachSCSIVolumeTestJSON-server-199503615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-199503615',id=7,image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/dlbiJbuKgyrsb8U3dpAD75aIbVSwTJs75OmR+LMNIDX+dKF9yjW4J+OnhzRPSy2Mt3UzJsQe6+TUXw731YpagDG9wW4UyQG+C9Zz0zJ/sLYOgjnh6al85v4iYN0M44A==',key_name='tempest-keypair-1858432515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='494af5d25e76404bad17a4a968463dfe',ramdisk_id='',reservation_id='r-md5o40iy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1537037127',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1537037127-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9a3f1bcf2a2451cba737f9a1ba47a3e',uuid=3d7e58a9-6acf-4584-bb38-1d88d536ed63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converting VIF {"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG os_vif [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc879d42-a4, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc879d42-a4, col_values=(('external_ids', {'iface-id': 'cc879d42-a438-41cb-9396-68694bf1c160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:a4:24', 'vm-uuid': '3d7e58a9-6acf-4584-bb38-1d88d536ed63'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:34:59 user nova-compute[71026]: INFO os_vif [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4')
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No BDM found with device name sda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No VIF found with MAC fa:16:3e:43:a4:24, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:34:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Using config drive
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Successfully updated port: d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquired lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:34:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Creating config drive at /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.config
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpriatqu45 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpriatqu45" returned: 0 in 0.070s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updated VIF entry in instance network info cache for port cc879d42-a438-41cb-9396-68694bf1c160. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating instance_info_cache with network_info: [{"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab1854ac-cc04-4d61-9823-d4bd6fb05d74 req-17bc07d2-e9a7-48f5-9a79-57f42d14f704 service nova] Releasing lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updating instance_info_cache with network_info: [{"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Releasing lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Instance network_info: |[{"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Start _get_guest_xml network_info=[{"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:34:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:34:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1716838670',display_name='tempest-VolumesAdminNegativeTest-server-1716838670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1716838670',id=8,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlTDVCVoCt5B486g5pFKW5EWWT2ZDWv+y4etA98Z8C1CMlR++fUPxNKKFKEaPI0H/+S9MBRAtEB1Qvj8dSykNUpMktTnUoaveSAL5fyeE52dGFXKeEPx4Q2ldNePxv4Eg==',key_name='tempest-keypair-312622122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-d4oun64m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789e9b39aef14ae4af5a48148b92994d',uuid=8243a940-bb67-45c5-ad47-4364a23b5cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.objects.instance [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'pci_devices' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:35:00 user nova-compute[71026]:   <uuid>8243a940-bb67-45c5-ad47-4364a23b5cd9</uuid>
Jul 27 16:35:00 user nova-compute[71026]:   <name>instance-00000008</name>
Jul 27 16:35:00 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:35:00 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:35:00 user nova-compute[71026]:   <metadata>
Jul 27 16:35:00 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:35:00 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1716838670</nova:name>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:34:59</nova:creationTime>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:35:00 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:35:00 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:owner>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:user uuid="789e9b39aef14ae4af5a48148b92994d">tempest-VolumesAdminNegativeTest-1182056978-project-member</nova:user>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:project uuid="6c84998d34fb49cb9cb17eb2b4353201">tempest-VolumesAdminNegativeTest-1182056978</nova:project>
Jul 27 16:35:00 user nova-compute[71026]:       </nova:owner>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:35:00 user nova-compute[71026]:       <nova:ports>
Jul 27 16:35:00 user nova-compute[71026]:         <nova:port uuid="d6ecd5de-a988-469b-b180-682819d64f45">
Jul 27 16:35:00 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:35:00 user nova-compute[71026]:         </nova:port>
Jul 27 16:35:00 user nova-compute[71026]:       </nova:ports>
Jul 27 16:35:00 user nova-compute[71026]:     </nova:instance>
Jul 27 16:35:00 user nova-compute[71026]:   </metadata>
Jul 27 16:35:00 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:35:00 user nova-compute[71026]:     <system>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="serial">8243a940-bb67-45c5-ad47-4364a23b5cd9</entry>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="uuid">8243a940-bb67-45c5-ad47-4364a23b5cd9</entry>
Jul 27 16:35:00 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:35:00 user nova-compute[71026]:     </system>
Jul 27 16:35:00 user nova-compute[71026]:   </sysinfo>
Jul 27 16:35:00 user nova-compute[71026]:   <os>
Jul 27 16:35:00 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:35:00 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:35:00 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:35:00 user nova-compute[71026]:   </os>
Jul 27 16:35:00 user nova-compute[71026]:   <features>
Jul 27 16:35:00 user nova-compute[71026]:     <acpi/>
Jul 27 16:35:00 user nova-compute[71026]:     <apic/>
Jul 27 16:35:00 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:35:00 user nova-compute[71026]:   </features>
Jul 27 16:35:00 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:35:00 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:35:00 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:35:00 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:35:00 user nova-compute[71026]:   </clock>
Jul 27 16:35:00 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:35:00 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:35:00 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:35:00 user nova-compute[71026]:   </cpu>
Jul 27 16:35:00 user nova-compute[71026]:   <devices>
Jul 27 16:35:00 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:35:00 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:35:00 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk"/>
Jul 27 16:35:00 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:35:00 user nova-compute[71026]:     </disk>
Jul 27 16:35:00 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:35:00 user nova-compute[71026]:       <mac address="fa:16:3e:16:be:b4"/>
Jul 27 16:35:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:35:00 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:35:00 user nova-compute[71026]:       <target dev="tapd6ecd5de-a9"/>
Jul 27 16:35:00 user nova-compute[71026]:     </interface>
Jul 27 16:35:00 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:35:00 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/console.log" append="off"/>
Jul 27 16:35:00 user nova-compute[71026]:     </serial>
Jul 27 16:35:00 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:35:00 user nova-compute[71026]:     <video>
Jul 27 16:35:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:35:00 user nova-compute[71026]:     </video>
Jul 27 16:35:00 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:35:00 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:35:00 user nova-compute[71026]:     </rng>
Jul 27 16:35:00 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:35:00 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:35:00 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:35:00 user nova-compute[71026]:     </memballoon>
Jul 27 16:35:00 user nova-compute[71026]:   </devices>
Jul 27 16:35:00 user nova-compute[71026]: </domain>
Jul 27 16:35:00 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1716838670',display_name='tempest-VolumesAdminNegativeTest-server-1716838670',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1716838670',id=8,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlTDVCVoCt5B486g5pFKW5EWWT2ZDWv+y4etA98Z8C1CMlR++fUPxNKKFKEaPI0H/+S9MBRAtEB1Qvj8dSykNUpMktTnUoaveSAL5fyeE52dGFXKeEPx4Q2ldNePxv4Eg==',key_name='tempest-keypair-312622122',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-d4oun64m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789e9b39aef14ae4af5a48148b92994d',uuid=8243a940-bb67-45c5-ad47-4364a23b5cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG os_vif [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ecd5de-a9, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ecd5de-a9, col_values=(('external_ids', {'iface-id': 'd6ecd5de-a988-469b-b180-682819d64f45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:be:b4', 'vm-uuid': '8243a940-bb67-45c5-ad47-4364a23b5cd9'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:00 user nova-compute[71026]: INFO os_vif [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9')
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No VIF found with MAC fa:16:3e:16:be:b4, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-changed-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Refreshing instance network info cache due to event network-changed-d6ecd5de-a988-469b-b180-682819d64f45. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] Acquiring lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] Acquired lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Refreshing network info cache for port d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updated VIF entry in instance network info cache for port d6ecd5de-a988-469b-b180-682819d64f45. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updating instance_info_cache with network_info: [{"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eafcb978-94c1-4210-8585-74484a92708f req-34837c96-5e2e-4b97-87fd-9a007eb586f6 service nova] Releasing lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:35:01 user nova-compute[71026]: INFO nova.compute.claims [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Claim successful on node user
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] No waiting events found dispatching network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:02 user nova-compute[71026]: WARNING nova.compute.manager [req-4f4a48e6-defe-4eca-8a43-2ac6b97c5bca req-307f14d0-aa4c-430d-a3be-f8630246eeaf service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received unexpected event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 for instance with vm_state building and task_state spawning.
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:35:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Creating image(s)
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "/opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "/opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "/opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:02 user nova-compute[71026]: WARNING nova.compute.manager [req-c7e7f45c-e53b-4cc0-b9ab-f359a2f01ce5 req-9f67f069-3a18-4a42-b52b-ddc92e23bd70 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state building and task_state spawning.
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG nova.policy [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '007fca7e89604eedad55092edd0ee200', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '427f14c9239c4e8fbc7751d600cbb5d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk 1073741824" returned: 0 in 0.062s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.188s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Cannot resize image /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'migration_context' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Ensure instance console log exists: /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Successfully created port: 1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] No waiting events found dispatching network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:04 user nova-compute[71026]: WARNING nova.compute.manager [req-079f0a62-9ef2-4cfd-ab81-17a67faa9dbe req-1935b46b-d51c-478e-81b0-19e3b511cf3b service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received unexpected event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 for instance with vm_state building and task_state spawning.
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Successfully updated port: 1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquired lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:04 user nova-compute[71026]: WARNING nova.compute.manager [req-0c888197-d245-4183-bd4f-c5ef16630859 req-6fbf9a02-94ac-44c3-b349-645984b94635 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state building and task_state spawning.
Jul 27 16:35:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.network.neutron [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updating instance_info_cache with network_info: [{"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475705.196267, 8243a940-bb67-45c5-ad47-4364a23b5cd9 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] VM Resumed (Lifecycle Event)
Jul 27 16:35:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Releasing lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Instance network_info: |[{"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Start _get_guest_xml network_info=[{"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Instance spawned successfully.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:35:05 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1639480165',display_name='tempest-TestVolumeSwap-server-1639480165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1639480165',id=9,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3vm4gidxK0l1ev82G1Qi/XOB49a3+xTWAf/ybiykqYj0vGAz0onwBnVez594nphSs5v3tLz28ltO+WWGbtW+F4kL9UCx3dqNsiAWsu4uam964xDXUkk7gZm/+KHLH4Gg==',key_name='tempest-keypair-1263266121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='427f14c9239c4e8fbc7751d600cbb5d3',ramdisk_id='',reservation_id='r-u4ezci17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1117520652',owner_user_name='tempest-TestVolumeSwap-1117520652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007fca7e89604eedad55092edd0ee200',uuid=4256bebd-a216-46e4-acd9-fa7fe38422cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converting VIF {"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.objects.instance [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'pci_devices' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475705.1985009, 8243a940-bb67-45c5-ad47-4364a23b5cd9 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] VM Started (Lifecycle Event)
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:35:05 user nova-compute[71026]:   <uuid>4256bebd-a216-46e4-acd9-fa7fe38422cd</uuid>
Jul 27 16:35:05 user nova-compute[71026]:   <name>instance-00000009</name>
Jul 27 16:35:05 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:35:05 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:35:05 user nova-compute[71026]:   <metadata>
Jul 27 16:35:05 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:35:05 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:name>tempest-TestVolumeSwap-server-1639480165</nova:name>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:35:05</nova:creationTime>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:35:05 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:35:05 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:owner>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:user uuid="007fca7e89604eedad55092edd0ee200">tempest-TestVolumeSwap-1117520652-project-member</nova:user>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:project uuid="427f14c9239c4e8fbc7751d600cbb5d3">tempest-TestVolumeSwap-1117520652</nova:project>
Jul 27 16:35:05 user nova-compute[71026]:       </nova:owner>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:35:05 user nova-compute[71026]:       <nova:ports>
Jul 27 16:35:05 user nova-compute[71026]:         <nova:port uuid="1e50cdea-515a-49c8-8d7b-264e6cd04cd0">
Jul 27 16:35:05 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 27 16:35:05 user nova-compute[71026]:         </nova:port>
Jul 27 16:35:05 user nova-compute[71026]:       </nova:ports>
Jul 27 16:35:05 user nova-compute[71026]:     </nova:instance>
Jul 27 16:35:05 user nova-compute[71026]:   </metadata>
Jul 27 16:35:05 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:35:05 user nova-compute[71026]:     <system>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="serial">4256bebd-a216-46e4-acd9-fa7fe38422cd</entry>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="uuid">4256bebd-a216-46e4-acd9-fa7fe38422cd</entry>
Jul 27 16:35:05 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:35:05 user nova-compute[71026]:     </system>
Jul 27 16:35:05 user nova-compute[71026]:   </sysinfo>
Jul 27 16:35:05 user nova-compute[71026]:   <os>
Jul 27 16:35:05 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:35:05 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:35:05 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:35:05 user nova-compute[71026]:   </os>
Jul 27 16:35:05 user nova-compute[71026]:   <features>
Jul 27 16:35:05 user nova-compute[71026]:     <acpi/>
Jul 27 16:35:05 user nova-compute[71026]:     <apic/>
Jul 27 16:35:05 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:35:05 user nova-compute[71026]:   </features>
Jul 27 16:35:05 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:35:05 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:35:05 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:35:05 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:35:05 user nova-compute[71026]:   </clock>
Jul 27 16:35:05 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:35:05 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:35:05 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:35:05 user nova-compute[71026]:   </cpu>
Jul 27 16:35:05 user nova-compute[71026]:   <devices>
Jul 27 16:35:05 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:35:05 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:35:05 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk"/>
Jul 27 16:35:05 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:35:05 user nova-compute[71026]:     </disk>
Jul 27 16:35:05 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:35:05 user nova-compute[71026]:       <mac address="fa:16:3e:0d:be:0d"/>
Jul 27 16:35:05 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:35:05 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:35:05 user nova-compute[71026]:       <target dev="tap1e50cdea-51"/>
Jul 27 16:35:05 user nova-compute[71026]:     </interface>
Jul 27 16:35:05 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:35:05 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/console.log" append="off"/>
Jul 27 16:35:05 user nova-compute[71026]:     </serial>
Jul 27 16:35:05 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:35:05 user nova-compute[71026]:     <video>
Jul 27 16:35:05 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:35:05 user nova-compute[71026]:     </video>
Jul 27 16:35:05 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:35:05 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:35:05 user nova-compute[71026]:     </rng>
Jul 27 16:35:05 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:35:05 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:35:05 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:35:05 user nova-compute[71026]:     </memballoon>
Jul 27 16:35:05 user nova-compute[71026]:   </devices>
Jul 27 16:35:05 user nova-compute[71026]: </domain>
Jul 27 16:35:05 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1639480165',display_name='tempest-TestVolumeSwap-server-1639480165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1639480165',id=9,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3vm4gidxK0l1ev82G1Qi/XOB49a3+xTWAf/ybiykqYj0vGAz0onwBnVez594nphSs5v3tLz28ltO+WWGbtW+F4kL9UCx3dqNsiAWsu4uam964xDXUkk7gZm/+KHLH4Gg==',key_name='tempest-keypair-1263266121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='427f14c9239c4e8fbc7751d600cbb5d3',ramdisk_id='',reservation_id='r-u4ezci17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1117520652',owner_user_name='tempest-TestVolumeSwap-1117520652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007fca7e89604eedad55092edd0ee200',uuid=4256bebd-a216-46e4-acd9-fa7fe38422cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converting VIF {"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG os_vif [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e50cdea-51, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e50cdea-51, col_values=(('external_ids', {'iface-id': '1e50cdea-515a-49c8-8d7b-264e6cd04cd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:be:0d', 'vm-uuid': '4256bebd-a216-46e4-acd9-fa7fe38422cd'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:35:05 user nova-compute[71026]: INFO os_vif [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51')
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Instance spawned successfully.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475705.29242, 3d7e58a9-6acf-4584-bb38-1d88d536ed63 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] VM Resumed (Lifecycle Event)
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Took 9.16 seconds to spawn the instance on the hypervisor.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] No VIF found with MAC fa:16:3e:0d:be:0d, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475705.2927222, 3d7e58a9-6acf-4584-bb38-1d88d536ed63 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] VM Started (Lifecycle Event)
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Took 10.53 seconds to spawn the instance on the hypervisor.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Took 11.44 seconds to build instance.
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-14519b67-b981-4d48-bfa9-8789e46975fe tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.562s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:05 user nova-compute[71026]: INFO nova.compute.manager [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Took 11.73 seconds to build instance.
Jul 27 16:35:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7054fe1e-bff3-4c9b-86c9-3c0c8baf5fa8 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.860s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-changed-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Refreshing instance network info cache due to event network-changed-1e50cdea-515a-49c8-8d7b-264e6cd04cd0. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] Acquiring lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] Acquired lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG nova.network.neutron [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Refreshing network info cache for port 1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG nova.network.neutron [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updated VIF entry in instance network info cache for port 1e50cdea-515a-49c8-8d7b-264e6cd04cd0. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG nova.network.neutron [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updating instance_info_cache with network_info: [{"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7dbcccc2-baf8-4e0e-8c27-5f9449f3e5da req-3fe3b00b-f6be-452b-97df-844121723d91 service nova] Releasing lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] No waiting events found dispatching network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:07 user nova-compute[71026]: WARNING nova.compute.manager [req-3af30dfb-9142-4287-9e67-4797c72923c8 req-99572990-5df2-4676-8e98-5d18a3872e37 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received unexpected event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 for instance with vm_state building and task_state spawning.
Jul 27 16:35:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 16:35:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] No waiting events found dispatching network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:35:09 user nova-compute[71026]: WARNING nova.compute.manager [req-5546c718-958c-411a-8745-fc178b98e0f8 req-5c1d6369-95c5-4b9d-a973-e7a89b88fc13 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received unexpected event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 for instance with vm_state building and task_state spawning.
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475709.7819598, 4256bebd-a216-46e4-acd9-fa7fe38422cd => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:09 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] VM Resumed (Lifecycle Event)
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:35:09 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Instance spawned successfully.
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:35:09 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475709.7820525, 4256bebd-a216-46e4-acd9-fa7fe38422cd => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:35:09 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] VM Started (Lifecycle Event)
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:35:09 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:35:10 user nova-compute[71026]: INFO nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Took 7.40 seconds to spawn the instance on the hypervisor.
Jul 27 16:35:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:35:10 user nova-compute[71026]: INFO nova.compute.manager [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Took 8.46 seconds to build instance.
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-73b65d69-8250-47cb-948f-efe48fa21413 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.571s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:14 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:35:14 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7409MB free_disk=25.908443450927734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance cec98ede-1131-4669-9e61-c10b291150f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4256bebd-a216-46e4-acd9-fa7fe38422cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:35:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:35:15 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:35:15 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:35:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:35:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updating instance_info_cache with network_info: [{"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-cec98ede-1131-4669-9e61-c10b291150f6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:35:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:35:38 user nova-compute[71026]: INFO nova.compute.claims [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Claim successful on node user
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 16:35:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:35:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:35:39 user nova-compute[71026]: INFO nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Booting with volume c5b0f0ad-6168-465d-8d08-f613fefbd5d2 at /dev/vda
Jul 27 16:35:39 user nova-compute[71026]: DEBUG nova.policy [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bf92dd356ac4b9cab696fda110c0fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a5d193270fe43fcb9516b643067600e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:35:39 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:35:39 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp4uepy01b/privsep.sock']
Jul 27 16:35:39 user sudo[82015]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp4uepy01b/privsep.sock
Jul 27 16:35:39 user sudo[82015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 27 16:35:40 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully created port: 968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:40 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully created port: 7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully created port: 7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:41 user sudo[82015]: pam_unix(sudo:session): session closed for user root
Jul 27 16:35:41 user nova-compute[71026]: INFO oslo.privsep.daemon [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Spawned new privsep daemon via rootwrap
Jul 27 16:35:41 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 27 16:35:41 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 27 16:35:41 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 27 16:35:41 user nova-compute[71026]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82023
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c602b26-828b-44e1-b7a3-8cee903e7499]: (2,) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65092d06-5ce0-4802-90c2-7e12d026e8fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: WARNING os_brick.initiator.connectors.nvmeof [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71498bce-54d7-4665-8c96-dc6ee6cceec0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0718d62b-9914-4be9-9009-d772ce47876d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b99803-cd30-4bf6-be59-4e8921385f96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:41 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:35:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40abe0b0-63dd-451f-858c-c62c18977edc]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== get_connector_properties: return (2352ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:35:41 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating existing volume attachment record: 3294d669-5e25-4184-9c0d-dd68887401ca {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:35:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully created port: f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully created port: 6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:35:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:35:43 user nova-compute[71026]: INFO nova.compute.claims [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Claim successful on node user
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-968f7270-4d51-4efe-9620-941bea39a65b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:35:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:35:44 user nova-compute[71026]: INFO nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Booting with volume c43a9fbf-4dd4-4e15-9486-03693f4e2055 at /dev/vda
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.policy [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ea19ebae24043b7a4504c09536f560e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fbff68dc0f147b6860273328c46fdb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b334d317-f57f-43d9-af9e-ff62eedd2580 req-04a89323-96e5-42f6-914c-04325559fa76 service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b023cf7c-69a7-46f5-a53c-8b87062da587]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb99627-2adf-4a65-aee9-b4c0cb01388b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[371fbeb4-da43-43d7-af11-6cd0cc553900]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89199d40-4fac-42c4-9c91-5467864262b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:44 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:35:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a479c-6136-4f74-8cb2-bd86ecfa168b]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:35:44 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating existing volume attachment record: 2b94da2c-7b0a-448a-ac3e-cac5b518bd2e {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:35:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully created port: db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully created port: cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-728203cb-6d0c-431c-90c4-4004fd686681. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully created port: 4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-54f8d3ee-511c-44c6-9f7a-6cd39c3c25d2 req-fcb5ea1f-ec3c-4a35-b64d-7df451ce454c service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully created port: 390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-6f400432-0713-4f30-b800-6b91a6631ff4. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully created port: 0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-7ad549db-6ffd-4627-8490-9fe04a140c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5691a3b3-ae1c-4ec9-9745-19be46ddbb2f req-9fdfca76-bd4a-4900-b753-d054f72b7768 service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:49 user nova-compute[71026]: INFO nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Booting with volume 18d2c607-7d5f-4615-befb-60bcfdc6f654 at /dev/vdb
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dcf990-2806-4ad3-8e8b-f3a6b55d5d7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d256354-a5d3-4cad-a60c-4bbe7987e12f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0a6dc09f-8083-4738-8a74-1d6c006d359c req-daf6dec6-33ee-4d71-b7ce-b8a1e3399f9f service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff17a0-201e-4c7b-bce5-23340ee30054]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20cf5ab-be39-449f-9be6-d0e0254a22a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:49 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:35:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fe2b70-232d-4bd4-8952-3e0b5c783b66]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:35:49 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating existing volume attachment record: d790f530-e3a2-442e-acfe-5fab7622810e {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-f85a48f1-7d0f-478f-a2d5-bdf6597980cf. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: 9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Successfully updated port: 6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68613b80-3611-49ab-b2d9-496d24277240 req-89fe0e52-7b6d-41c9-bd98-d54199ff6dad service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-d8db6e99-efb8-4e4c-b705-9d7b167b1f79. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-9caf0fb5-11ae-47c0-94ee-954e326b4a40. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port 9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-6919b96c-f209-4c0f-b6fb-130ec7025c06. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ef0f2df9-a8bb-4533-83e9-7c6499136c6b req-41a77f1d-5879-4c66-a636-198e618abe27 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: 4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:53 user nova-compute[71026]: INFO nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Booting with volume 88cc22ca-1bac-4699-8c30-e36ad1e22ab3 at /dev/vdb
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a36480-0c23-4613-8f38-4c94e4c26842]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae1f11-10c8-4bf6-9c12-37ca1558bf8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f9d63-6ebf-4769-829c-02d96cc4976f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e4826-d886-406a-9415-588576073feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-cc539af1-fb26-48dc-a76e-fa75b0fce4d8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:53 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:35:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7291e9-15e5-4831-96c7-e0d65593d3af]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating existing volume attachment record: 925dab04-babf-4f65-942f-dd07e76dcc61 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:35:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: 390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port 4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519ea8e9-8da3-4398-b23b-3df981aceea1 req-939fd98f-61cc-439d-85de-4d78ca96ebf1 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-390a7b2e-5b2c-4ea5-b9fb-e8830541a110. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port 390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance network_info: |[{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Successfully updated port: 0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:35:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-142f7b50-23a7-4039-9dfd-6772562a0373 req-ddd7798f-2d38-4cb1-91d0-26870c4705f0 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG nova.network.neutron [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updated VIF entry in instance network info cache for port 6919b96c-f209-4c0f-b6fb-130ec7025c06. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG nova.network.neutron [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f284b49-f5d2-42f0-a107-fb3459d8a043 req-ea5e7acc-758e-499c-897a-6274d7537a06 service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:57 user nova-compute[71026]: INFO nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Booting with volume 8677d731-33d9-46f5-a148-a2335903673c at /dev/vdc
Jul 27 16:35:57 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6098775e-b2fe-4d06-96e7-88466015c4bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd1134-90ba-496a-8e65-7664600bfcb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[188d35e0-6c89-402b-92ff-e7066331a97d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e5647-96ee-420a-a255-1963a421175f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:35:58 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb2d203-c427-4ad3-b3bc-b35369da9379]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG os_brick.utils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating existing volume attachment record: e0684771-d3c0-49f0-a0f5-b32ff3b96463 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance network_info: |[{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port 0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updated VIF entry in instance network info cache for port 0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:35:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-99a69dea-4f0c-4b6e-b9ed-04243010409a req-46118641-84c4-4ddd-b2bc-dcd3c71e4240 service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:01 user nova-compute[71026]: INFO nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Booting with volume 10847339-5a9e-4546-9fa6-9982db36d069 at /dev/vdc
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec2948-7c2a-4132-9449-235c254e8652]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc27294-8ea8-49be-8cd9-d6b3d5a1573d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4addc91e-de44-4401-991f-d83881ceffd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b2afe-c16b-428d-b759-cd4dc8545a3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:01 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:36:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff149761-ba12-48fe-9bcd-04def7b85580]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG os_brick.utils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:01 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating existing volume attachment record: 2bed13cd-6255-44fc-9c39-d0f4994d96b5 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:36:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:36:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Creating image(s)
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Ensure instance console log exists: /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Start _get_guest_xml network_info=[{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3294d669-5e25-4184-9c0d-dd68887401ca', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJhcvlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 'serial': 'c5b0f0ad-6168-465d-8d08-f613fefbd5d2'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'd790f530-e3a2-442e-acfe-5fab7622810e', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJMKdrgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b', 'attached_at': '', 'detached_at': '', 'volume_id': '18d2c607-7d5f-4615-befb-60bcfdc6f654', 'serial': '18d2c607-7d5f-4615-befb-60bcfdc6f654'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'e0684771-d3c0-49f0-a0f5-b32ff3b96463', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGBOChSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b', 'attached_at': '', 'detached_at': '', 'volume_id': '8677d731-33d9-46f5-a148-a2335903673c', 'serial': '8677d731-33d9-46f5-a148-a2335903673c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:36:06 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:06 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connector [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Factory for ISCSI on None {{(pid=71026) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJhcvlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:06 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a35cb-6b40-4c00-937a-a7f7ba854fc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:06 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0abeb9-5a65-43e8-b16c-2711932299bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2] added
Jul 27 16:36:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf4ef4-c034-4046-9769-d1649574c2f5]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f7b3de-3f1b-4085-b127-0783bda9839b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJhcvlj {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oRJhcvlj" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8e17d2-d517-4cab-8aaa-3513a18cacfd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oRJhcvlj'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[021cc023-31f4-4ea2-b95f-472c9f36e225]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23687e3f-3bbe-43f5-bed0-e315328dfa0b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:36:06 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:36:06 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 16:36:06 user nova-compute[71026]: 
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c816a483-6119-4920-8e6a-7b5d406b782d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260]
Jul 27 16:36:06 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f26a485-508a-428d-85da-9986734e33d6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baa5f79-ea18-4c36-8736-f83b9a3c79f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fac848-8fe1-4b47-8fad-2724bf022ccd]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJhcvlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26631653139643936', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631653139643936', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJMKdrgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:07 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:07 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:07 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[43614882-93a8-4773-8087-bf5f51cc562c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:07 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d9e2a-662b-46cb-91ee-356c8d96b792]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654] added
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0c7f45-5fb8-43ef-bf08-ace5c7247f14]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a110d98b-a2c6-4a6b-a4b3-269a42d5328c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJMKdrgi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BJMKdrgi" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3312618-729c-4b1c-aa74-572a02a82ace]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BJMKdrgi'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2a030-ec28-49ac-b6f1-ac89d4d0cc39]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b56ad9a-c970-419b-9098-7e4da5d13e52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da80c02f-9701-412f-8e09-c5fd3916fd2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260]
Jul 27 16:36:07 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9dcb10-82ce-4798-9295-67dedd82be70]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13038f38-5864-4350-ab46-546f38e8688c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe566e5-bba1-416c-9432-524d983204bb]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJMKdrgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lazy-loading 'flavor' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:08 user nova-compute[71026]: INFO nova.compute.manager [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Attaching volume 88c3e20b-35bc-4c84-b3df-8129325a3bbf to /dev/vdb
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.utils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd9e5e-3d93-4b26-9691-1bab8c266288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b998b-55a5-435f-88ca-49e24ef64762]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0039f2-b07e-4554-9fa4-b3caaed3dba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f35b57-97c5-4294-a2b4-33a50623f790]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:08 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:36:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[477e7be5-68a8-41f5-9136-4d85cff79df8]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.utils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updating existing volume attachment record: 2cb35d82-f909-4b86-8e5a-5dd436e9314e {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26264633636613061', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264633636613061', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGBOChSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:09 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:09 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:09 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d34b86-a4c6-4b5d-ac22-338c11418292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:09 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576ff8c-1b8e-4ebc-bb3f-47d288fdb2f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c] added
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d2b75-0ed5-4430-b04e-d2859c1a8ec7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.075s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd65e0b-d61e-4f5d-813a-1b698eeb7611]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGBOChSi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGBOChSi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f24a86f-2793-408c-b50c-c47c3e9cf314]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGBOChSi'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563e0a7-6b79-4640-a796-42fe373247ee]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[932f83ab-68b0-4bf2-914f-6ff4b41416ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542ba84-690c-489f-bb4f-b45f522aa695]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260]
Jul 27 16:36:09 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79835f1c-6d8d-4fc5-bbb0-1d4bfd945b0b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43ab83-aba9-4074-8709-badd95eb120e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:09 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.530s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3637d671-1f96-41d0-941e-cc37dba51469]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGBOChSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:36:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Creating image(s)
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Ensure instance console log exists: /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Start _get_guest_xml network_info=[{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2b94da2c-7b0a-448a-ac3e-cac5b518bd2e', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiWoyswV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'c43a9fbf-4dd4-4e15-9486-03693f4e2055', 'serial': 'c43a9fbf-4dd4-4e15-9486-03693f4e2055'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '925dab04-babf-4f65-942f-dd07e76dcc61', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISqHlUse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc', 'attached_at': '', 'detached_at': '', 'volume_id': '88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 'serial': '88cc22ca-1bac-4699-8c30-e36ad1e22ab3'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '2bed13cd-6255-44fc-9c39-d0f4994d96b5', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOnjNpWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc', 'attached_at': '', 'detached_at': '', 'volume_id': '10847339-5a9e-4546-9fa6-9982db36d069', 'serial': '10847339-5a9e-4546-9fa6-9982db36d069'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:36:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiWoyswV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '23166656435626464', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166656435626464', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.346s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c1bd5b-668c-4af8-b280-fb2c0346d2fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:10 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lazy-loading 'pci_devices' on Instance uuid d79cf19e-8872-4bf6-ac21-3832ce196f1b {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e515f0-fb4a-4161-b5c7-0abf41ba8ac5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055] added
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:36:10 user nova-compute[71026]:   <uuid>d79cf19e-8872-4bf6-ac21-3832ce196f1b</uuid>
Jul 27 16:36:10 user nova-compute[71026]:   <name>instance-0000000a</name>
Jul 27 16:36:10 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:36:10 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:36:10 user nova-compute[71026]:   <metadata>
Jul 27 16:36:10 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:36:10 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:name>tempest-device-tagging-server-2066672567</nova:name>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:36:06</nova:creationTime>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:36:10 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:36:10 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:owner>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:user uuid="3bf92dd356ac4b9cab696fda110c0fd4">tempest-TaggedBootDevicesTest-744779166-project-member</nova:user>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:project uuid="3a5d193270fe43fcb9516b643067600e">tempest-TaggedBootDevicesTest-744779166</nova:project>
Jul 27 16:36:10 user nova-compute[71026]:       </nova:owner>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:36:10 user nova-compute[71026]:       <nova:ports>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="968f7270-4d51-4efe-9620-941bea39a65b">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="728203cb-6d0c-431c-90c4-4004fd686681">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="6f400432-0713-4f30-b800-6b91a6631ff4">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="7ad549db-6ffd-4627-8490-9fe04a140c98">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.244" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="f85a48f1-7d0f-478f-a2d5-bdf6597980cf">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:         <nova:port uuid="6919b96c-f209-4c0f-b6fb-130ec7025c06">
Jul 27 16:36:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 16:36:10 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:10 user nova-compute[71026]:       </nova:ports>
Jul 27 16:36:10 user nova-compute[71026]:     </nova:instance>
Jul 27 16:36:10 user nova-compute[71026]:   </metadata>
Jul 27 16:36:10 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:36:10 user nova-compute[71026]:     <system>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="serial">d79cf19e-8872-4bf6-ac21-3832ce196f1b</entry>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="uuid">d79cf19e-8872-4bf6-ac21-3832ce196f1b</entry>
Jul 27 16:36:10 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:36:10 user nova-compute[71026]:     </system>
Jul 27 16:36:10 user nova-compute[71026]:   </sysinfo>
Jul 27 16:36:10 user nova-compute[71026]:   <os>
Jul 27 16:36:10 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:36:10 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:36:10 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:36:10 user nova-compute[71026]:   </os>
Jul 27 16:36:10 user nova-compute[71026]:   <features>
Jul 27 16:36:10 user nova-compute[71026]:     <acpi/>
Jul 27 16:36:10 user nova-compute[71026]:     <apic/>
Jul 27 16:36:10 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:36:10 user nova-compute[71026]:   </features>
Jul 27 16:36:10 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:36:10 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:36:10 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:36:10 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:36:10 user nova-compute[71026]:   </clock>
Jul 27 16:36:10 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:36:10 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:36:10 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:36:10 user nova-compute[71026]:   </cpu>
Jul 27 16:36:10 user nova-compute[71026]:   <devices>
Jul 27 16:36:10 user nova-compute[71026]:     <disk type="file" device="cdrom">
Jul 27 16:36:10 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 16:36:10 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/disk.config"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="hda" bus="ide"/>
Jul 27 16:36:10 user nova-compute[71026]:     </disk>
Jul 27 16:36:10 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:10 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:10 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <serial>c5b0f0ad-6168-465d-8d08-f613fefbd5d2</serial>
Jul 27 16:36:10 user nova-compute[71026]:     </disk>
Jul 27 16:36:10 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:10 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:10 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <serial>18d2c607-7d5f-4615-befb-60bcfdc6f654</serial>
Jul 27 16:36:10 user nova-compute[71026]:     </disk>
Jul 27 16:36:10 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:10 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:10 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="vdc" bus="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <serial>8677d731-33d9-46f5-a148-a2335903673c</serial>
Jul 27 16:36:10 user nova-compute[71026]:     </disk>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:8c:1a:7b"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap968f7270-4d"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:5b:29:b4"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap728203cb-6d"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:f9:ce:61"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap6f400432-07"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:0d:77:50"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap7ad549db-6f"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:41:d9:d9"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap7b5a2416-d6"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:05:1c:7c"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tapf85a48f1-7d"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:10 user nova-compute[71026]:       <mac address="fa:16:3e:0a:ca:c2"/>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:10 user nova-compute[71026]:       <target dev="tap6919b96c-f2"/>
Jul 27 16:36:10 user nova-compute[71026]:     </interface>
Jul 27 16:36:10 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:36:10 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/console.log" append="off"/>
Jul 27 16:36:10 user nova-compute[71026]:     </serial>
Jul 27 16:36:10 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:36:10 user nova-compute[71026]:     <video>
Jul 27 16:36:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:10 user nova-compute[71026]:     </video>
Jul 27 16:36:10 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:36:10 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:36:10 user nova-compute[71026]:     </rng>
Jul 27 16:36:10 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:36:10 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:36:10 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:36:10 user nova-compute[71026]:     </memballoon>
Jul 27 16:36:10 user nova-compute[71026]:   </devices>
Jul 27 16:36:10 user nova-compute[71026]: </domain>
Jul 27 16:36:10 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc5c5ee-b9c9-4ad1-b69f-72130387189f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap968f7270-4d, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap968f7270-4d, col_values=(('external_ids', {'iface-id': '968f7270-4d51-4efe-9620-941bea39a65b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:1a:7b', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d')
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap728203cb-6d, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap728203cb-6d, col_values=(('external_ids', {'iface-id': '728203cb-6d0c-431c-90c4-4004fd686681', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:29:b4', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c12b23-c499-4d32-a47a-f4ee4b241e4b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiWoyswV {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OiWoyswV" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a21c1-b8b3-4810-908c-1638bc2a650a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OiWoyswV'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d')
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f400432-07, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f400432-07, col_values=(('external_ids', {'iface-id': '6f400432-0713-4f30-b800-6b91a6631ff4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ce:61', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7919cd-cd75-4ec9-8305-fb4d741bbd23]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07')
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c98d94-9bf8-49c5-8752-36db2e969c2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ad549db-6f, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ad549db-6f, col_values=(('external_ids', {'iface-id': '7ad549db-6ffd-4627-8490-9fe04a140c98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:77:50', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f')
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b5a2416-d6, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b5a2416-d6, col_values=(('external_ids', {'iface-id': '7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:d9:d9', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c690bb4-e9ab-4fd2-aef0-d3e410e350a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260]
Jul 27 16:36:10 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad3aa6-568f-4deb-9c47-ac28aa1d0f83]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6')
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f7aa9-8168-41cd-8e5e-c3dc4e6a6ead]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:10 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf85a48f1-7d, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf85a48f1-7d, col_values=(('external_ids', {'iface-id': 'f85a48f1-7d0f-478f-a2d5-bdf6597980cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:1c:7c', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c524f69-7664-4c38-8ecf-e31a454b01b9]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiWoyswV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:11 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d')
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6919b96c-f2, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6919b96c-f2, col_values=(('external_ids', {'iface-id': '6919b96c-f209-4c0f-b6fb-130ec7025c06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:ca:c2', 'vm-uuid': 'd79cf19e-8872-4bf6-ac21-3832ce196f1b'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:11 user nova-compute[71026]: INFO os_vif [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2')
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] No BDM found with device name hda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] No VIF found with MAC fa:16:3e:8c:1a:7b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] No VIF found with MAC fa:16:3e:41:d9:d9, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Using config drive
Jul 27 16:36:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Creating config drive at /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/disk.config
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6uop2p7l {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:36:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6uop2p7l" returned: 0 in 0.062s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== connect_volume: return (1710ms) {'type': 'block', 'scsi_wwn': '23463643733353863', 'path': '/dev/sde'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463643733353863', 'path': '/dev/sde'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISqHlUse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:12 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:12 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:12 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca41ee26-d94f-4fa3-96de-e5972d254099]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:12 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dba277-f325-4941-999f-6a275e296dc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3] added
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b86b77-ce39-463e-abee-64ac975b48d5]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b845b5df-71aa-4f55-b36d-6e9d426bba17]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISqHlUse {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISqHlUse" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b388dac4-cb15-46b4-9bdd-1d4c35581582]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISqHlUse'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f14bb5-8fb5-4087-807e-6ef11e974aaa]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d5448a-f3b7-4c16-a39c-832025257b86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2947c0-9421-4497-b5e9-515fa57fa582]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260]
Jul 27 16:36:12 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cc5276-f026-4583-9d86-013ede700845]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd5aff-bf94-4dfc-8ed4-f4c8c9c3ca15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da68f9-de0f-41ee-8f86-b56715881b6d]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISqHlUse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing instance network info cache due to event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:13 user nova-compute[71026]: WARNING nova.compute.manager [req-9cef4df6-a260-4e0c-a346-5752bfe90945 req-3844cf9c-dcae-498c-bf89-c619e8e599f5 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b for instance with vm_state building and task_state spawning.
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23538323836356362', 'path': '/dev/sdf'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538323836356362', 'path': '/dev/sdf'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOnjNpWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:13 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa18a380-4c34-43a6-987c-654c1e49b64d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:13 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a037c56e-14c6-41d6-9c93-55c81708c285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069] added
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ca6c8-0194-4c15-8fc3-b5a47da1bb3b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d81174f-aa33-46b3-9226-1466117a2cdc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOnjNpWL {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KOnjNpWL" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359a7a6-ac26-4f9f-9cae-4417c9f385d1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KOnjNpWL'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4c1c3a-54f5-4aad-bc3a-be0ed91d4c97]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6e79be-ed8e-4eea-8cc4-ea096c1d5fe4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a0c40-722f-4e23-af82-0f88ea8faf3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260]
Jul 27 16:36:13 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d05a3-18d0-4289-8389-ad52cb6f8997]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db7e34c-a2a7-4ecf-98e9-77de16da9d9a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[910fbf41-769f-4d91-88b7-e4a4345fe0c7]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOnjNpWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updated VIF entry in instance network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-940af3bb-8b2c-4fb8-bedd-f353a88a1fb5 req-3d52596e-384c-47e9-b89c-6d6f9a0c435c service nova] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23337306164323635', 'path': '/dev/sdg'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337306164323635', 'path': '/dev/sdg'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lazy-loading 'pci_devices' on Instance uuid 259fd1d1-10f6-443e-ac1a-2824ee3c04fc {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:36:15 user nova-compute[71026]:   <uuid>259fd1d1-10f6-443e-ac1a-2824ee3c04fc</uuid>
Jul 27 16:36:15 user nova-compute[71026]:   <name>instance-0000000b</name>
Jul 27 16:36:15 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:36:15 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:36:15 user nova-compute[71026]:   <metadata>
Jul 27 16:36:15 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:36:15 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:name>tempest-device-tagging-server-1263370229</nova:name>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:36:10</nova:creationTime>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:36:15 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:36:15 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:owner>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:user uuid="9ea19ebae24043b7a4504c09536f560e">tempest-TaggedBootDevicesTest_v242-59168722-project-member</nova:user>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:project uuid="4fbff68dc0f147b6860273328c46fdb6">tempest-TaggedBootDevicesTest_v242-59168722</nova:project>
Jul 27 16:36:15 user nova-compute[71026]:       </nova:owner>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:36:15 user nova-compute[71026]:       <nova:ports>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="db31dc20-d0e7-4e5d-a4ea-c0fe71096d54">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="d8db6e99-efb8-4e4c-b705-9d7b167b1f79">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="9caf0fb5-11ae-47c0-94ee-954e326b4a40">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.132" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="cc539af1-fb26-48dc-a76e-fa75b0fce4d8">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="390a7b2e-5b2c-4ea5-b9fb-e8830541a110">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:         <nova:port uuid="0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4">
Jul 27 16:36:15 user nova-compute[71026]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 27 16:36:15 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:15 user nova-compute[71026]:       </nova:ports>
Jul 27 16:36:15 user nova-compute[71026]:     </nova:instance>
Jul 27 16:36:15 user nova-compute[71026]:   </metadata>
Jul 27 16:36:15 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:36:15 user nova-compute[71026]:     <system>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="serial">259fd1d1-10f6-443e-ac1a-2824ee3c04fc</entry>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="uuid">259fd1d1-10f6-443e-ac1a-2824ee3c04fc</entry>
Jul 27 16:36:15 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:36:15 user nova-compute[71026]:     </system>
Jul 27 16:36:15 user nova-compute[71026]:   </sysinfo>
Jul 27 16:36:15 user nova-compute[71026]:   <os>
Jul 27 16:36:15 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:36:15 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:36:15 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:36:15 user nova-compute[71026]:   </os>
Jul 27 16:36:15 user nova-compute[71026]:   <features>
Jul 27 16:36:15 user nova-compute[71026]:     <acpi/>
Jul 27 16:36:15 user nova-compute[71026]:     <apic/>
Jul 27 16:36:15 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:36:15 user nova-compute[71026]:   </features>
Jul 27 16:36:15 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:36:15 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:36:15 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:36:15 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:36:15 user nova-compute[71026]:   </clock>
Jul 27 16:36:15 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:36:15 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:36:15 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:36:15 user nova-compute[71026]:   </cpu>
Jul 27 16:36:15 user nova-compute[71026]:   <devices>
Jul 27 16:36:15 user nova-compute[71026]:     <disk type="file" device="cdrom">
Jul 27 16:36:15 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 16:36:15 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/disk.config"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="hda" bus="ide"/>
Jul 27 16:36:15 user nova-compute[71026]:     </disk>
Jul 27 16:36:15 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:15 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:15 user nova-compute[71026]:       <source dev="/dev/sde"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <serial>c43a9fbf-4dd4-4e15-9486-03693f4e2055</serial>
Jul 27 16:36:15 user nova-compute[71026]:     </disk>
Jul 27 16:36:15 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:15 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:15 user nova-compute[71026]:       <source dev="/dev/sdf"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <serial>88cc22ca-1bac-4699-8c30-e36ad1e22ab3</serial>
Jul 27 16:36:15 user nova-compute[71026]:     </disk>
Jul 27 16:36:15 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:36:15 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:15 user nova-compute[71026]:       <source dev="/dev/sdg"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="vdc" bus="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <serial>10847339-5a9e-4546-9fa6-9982db36d069</serial>
Jul 27 16:36:15 user nova-compute[71026]:     </disk>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:f8:46:56"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tapdb31dc20-d0"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:d2:07:32"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tapd8db6e99-ef"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:4e:85:3c"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tap9caf0fb5-11"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:41:67:a6"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tapcc539af1-fb"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:d1:c8:1f"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tap4ae2987d-30"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:3f:eb:67"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tap390a7b2e-5b"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:15 user nova-compute[71026]:       <mac address="fa:16:3e:d0:7a:d1"/>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:15 user nova-compute[71026]:       <target dev="tap0b2386fd-4a"/>
Jul 27 16:36:15 user nova-compute[71026]:     </interface>
Jul 27 16:36:15 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:36:15 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/console.log" append="off"/>
Jul 27 16:36:15 user nova-compute[71026]:     </serial>
Jul 27 16:36:15 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:36:15 user nova-compute[71026]:     <video>
Jul 27 16:36:15 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:15 user nova-compute[71026]:     </video>
Jul 27 16:36:15 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:36:15 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:36:15 user nova-compute[71026]:     </rng>
Jul 27 16:36:15 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:36:15 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:36:15 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:36:15 user nova-compute[71026]:     </memballoon>
Jul 27 16:36:15 user nova-compute[71026]:   </devices>
Jul 27 16:36:15 user nova-compute[71026]: </domain>
Jul 27 16:36:15 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb31dc20-d0, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb31dc20-d0, col_values=(('external_ids', {'iface-id': 'db31dc20-d0e7-4e5d-a4ea-c0fe71096d54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:46:56', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8db6e99-ef, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8db6e99-ef, col_values=(('external_ids', {'iface-id': 'd8db6e99-efb8-4e4c-b705-9d7b167b1f79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:07:32', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9caf0fb5-11, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9caf0fb5-11, col_values=(('external_ids', {'iface-id': '9caf0fb5-11ae-47c0-94ee-954e326b4a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:85:3c', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-a25883ac-9f47-4e7c-b7a2-8d9d8aed89f9 req-fb1718b6-02ae-42e5-88bb-b9da357b8d81 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc539af1-fb, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc539af1-fb, col_values=(('external_ids', {'iface-id': 'cc539af1-fb26-48dc-a76e-fa75b0fce4d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:67:a6', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ae2987d-30, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ae2987d-30, col_values=(('external_ids', {'iface-id': '4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c8:1f', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap390a7b2e-5b, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap390a7b2e-5b, col_values=(('external_ids', {'iface-id': '390a7b2e-5b2c-4ea5-b9fb-e8830541a110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:eb:67', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:15 user nova-compute[71026]: WARNING nova.compute.manager [req-c14ca5c3-54ea-4dfe-9dbe-ff1d25151cb2 req-2058769c-1578-41be-9f93-13c6b0d94447 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 for instance with vm_state building and task_state spawning.
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b2386fd-4a, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b2386fd-4a, col_values=(('external_ids', {'iface-id': '0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:7a:d1', 'vm-uuid': '259fd1d1-10f6-443e-ac1a-2824ee3c04fc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO nova.compute.manager [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] instance snapshotting
Jul 27 16:36:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:15 user nova-compute[71026]: INFO os_vif [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a')
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:36:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Beginning live snapshot process
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] No BDM found with device name hda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] No VIF found with MAC fa:16:3e:f8:46:56, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] No VIF found with MAC fa:16:3e:d1:c8:1f, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Using config drive
Jul 27 16:36:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:36:16 user nova-compute[71026]: INFO nova.compute.claims [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Claim successful on node user
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: INFO nova.compute.manager [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Rescuing
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG nova.network.neutron [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Creating config drive at /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/disk.config
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpswhc6xi5 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.227s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4.delta 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpswhc6xi5" returned: 0 in 0.118s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4.delta 1073741824" returned: 0 in 0.111s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71026) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.virt.libvirt.host [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] UEFI support detected
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.network.neutron [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-f2211824-1093-4dc2-989e-7c95f2e450a2 req-e13f0dbd-1fc3-43fc-b82a-9b39b9a2d765 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.370s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:17 user nova-compute[71026]: WARNING nova.compute.manager [req-45c8c2c8-042a-4d05-8532-a91d0ac7c71b req-927ea35a-3627-4386-ba05-633e5e51d6fa service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 for instance with vm_state building and task_state spawning.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475777.849737, d79cf19e-8872-4bf6-ac21-3832ce196f1b => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] VM Resumed (Lifecycle Event)
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.policy [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ce09c32af684da283531bdabc3e15a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '861424cabfc04dcd801426788ce536d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance spawned successfully.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475777.8553317, d79cf19e-8872-4bf6-ac21-3832ce196f1b => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] VM Started (Lifecycle Event)
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:36:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Creating image(s)
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "/opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "/opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:18 user nova-compute[71026]: WARNING nova.compute.manager [req-f342abca-aa9e-4998-b96e-1d3a2c40db70 req-61c3be16-aac9-4c84-8cdb-8497ebc25203 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state active and task_state rescuing.
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: INFO nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Took 12.12 seconds to spawn the instance on the hypervisor.
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk 1073741824" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: INFO nova.compute.manager [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Took 40.11 seconds to build instance.
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.196s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9d5ff39e-8704-402d-8eae-2efb20ab869a tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.366s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqkArLib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:18 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:18 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:18 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] COPY block job progress, current cursor: 15007744 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Cannot resize image /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'migration_context' on Instance uuid f0e1f730-6df4-44b8-b794-44a80ccefd06 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a8219-7810-4952-8e5a-8cd992fa025c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:18 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Ensure instance console log exists: /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b2762-e00e-4007-a974-5f3f22569dd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf] added
Jul 27 16:36:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bd33f-bdf4-4c7a-99a3-97f3cdb5e5f2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[de229812-0398-46c0-9940-e70ca02a05fc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqkArLib {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqkArLib" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f58d69-63e5-49ee-9634-942d8beec77f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqkArLib'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1099c45-88ed-4a4b-807c-bafb290bdfd4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ad42f-fe5c-4cba-bc7c-187675922651]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Successfully created port: 96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:36:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance destroyed successfully.
Jul 27 16:36:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Attempting rescue
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a41da-d578-48ca-873f-d5157d72dfe5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260]
Jul 27 16:36:19 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:36:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Creating image(s)
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'trusted_certs' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b6296-1a10-4932-adaf-f0c40df9cb54]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d372581c-62f3-4fd6-b3d0-554fd031dd0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)
Jul 27 16:36:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:19 user nova-compute[71026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)
Jul 27 16:36:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3ead6-564d-415e-b733-051a10745452]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqkArLib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:36:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue" returned: 0 in 0.071s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start _get_guest_xml network_info=[{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:21:2e:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'numa_topology' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.593s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4.delta /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-367530359',display_name='tempest-ServerRescueNegativeTestJSON-server-367530359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-367530359',id=5,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-nug1sdfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:43Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=d6e2b6dc-8408-4f7d-8286-68fd01ef25c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:21:2e:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:21:2e:1c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:20 user nova-compute[71026]: WARNING nova.compute.manager [req-d8cdff34-c4fc-4650-b54d-589771db8aac req-5c338029-2010-42c3-84fb-d9fb7041ca65 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state active and task_state rescuing.
Jul 27 16:36:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:36:20 user nova-compute[71026]:   <uuid>d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</uuid>
Jul 27 16:36:20 user nova-compute[71026]:   <name>instance-00000005</name>
Jul 27 16:36:20 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:36:20 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:36:20 user nova-compute[71026]:   <metadata>
Jul 27 16:36:20 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:36:20 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-367530359</nova:name>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:36:20</nova:creationTime>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:36:20 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:36:20 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:owner>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:36:20 user nova-compute[71026]:       </nova:owner>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:36:20 user nova-compute[71026]:       <nova:ports>
Jul 27 16:36:20 user nova-compute[71026]:         <nova:port uuid="e03a7098-b905-4b6b-8f2f-9eb80afc928d">
Jul 27 16:36:20 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:36:20 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:20 user nova-compute[71026]:       </nova:ports>
Jul 27 16:36:20 user nova-compute[71026]:     </nova:instance>
Jul 27 16:36:20 user nova-compute[71026]:   </metadata>
Jul 27 16:36:20 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:36:20 user nova-compute[71026]:     <system>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="serial">d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</entry>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="uuid">d6e2b6dc-8408-4f7d-8286-68fd01ef25c6</entry>
Jul 27 16:36:20 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:36:20 user nova-compute[71026]:     </system>
Jul 27 16:36:20 user nova-compute[71026]:   </sysinfo>
Jul 27 16:36:20 user nova-compute[71026]:   <os>
Jul 27 16:36:20 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:36:20 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:36:20 user nova-compute[71026]:   </os>
Jul 27 16:36:20 user nova-compute[71026]:   <features>
Jul 27 16:36:20 user nova-compute[71026]:     <acpi/>
Jul 27 16:36:20 user nova-compute[71026]:     <apic/>
Jul 27 16:36:20 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:36:20 user nova-compute[71026]:   </features>
Jul 27 16:36:20 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:36:20 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:36:20 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:36:20 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:36:20 user nova-compute[71026]:   </clock>
Jul 27 16:36:20 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:36:20 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:36:20 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:36:20 user nova-compute[71026]:   </cpu>
Jul 27 16:36:20 user nova-compute[71026]:   <devices>
Jul 27 16:36:20 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:36:20 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:36:20 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue"/>
Jul 27 16:36:20 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:36:20 user nova-compute[71026]:     </disk>
Jul 27 16:36:20 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:36:20 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:36:20 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk"/>
Jul 27 16:36:20 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:36:20 user nova-compute[71026]:     </disk>
Jul 27 16:36:20 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:20 user nova-compute[71026]:       <mac address="fa:16:3e:21:2e:1c"/>
Jul 27 16:36:20 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:20 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:20 user nova-compute[71026]:       <target dev="tape03a7098-b9"/>
Jul 27 16:36:20 user nova-compute[71026]:     </interface>
Jul 27 16:36:20 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:36:20 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/console.log" append="off"/>
Jul 27 16:36:20 user nova-compute[71026]:     </serial>
Jul 27 16:36:20 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:36:20 user nova-compute[71026]:     <video>
Jul 27 16:36:20 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:20 user nova-compute[71026]:     </video>
Jul 27 16:36:20 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:36:20 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:36:20 user nova-compute[71026]:     </rng>
Jul 27 16:36:20 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:36:20 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:36:20 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:36:20 user nova-compute[71026]:     </memballoon>
Jul 27 16:36:20 user nova-compute[71026]:   </devices>
Jul 27 16:36:20 user nova-compute[71026]: </domain>
Jul 27 16:36:20 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Successfully updated port: 96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475784.3157015, 259fd1d1-10f6-443e-ac1a-2824ee3c04fc => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] VM Resumed (Lifecycle Event)
Jul 27 16:36:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4.delta /opt/stack/data/nova/instances/snapshots/tmpct99rdf1/b0e8562bc7b54e81b22406caccf7bae4" returned: 0 in 4.556s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 5.859s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] <== connect_volume: return (5861ms) {'type': 'block', 'scsi_wwn': '23739323432313139', 'path': '/dev/sdh'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739323432313139', 'path': '/dev/sdh'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-ff835278-fb05-408c-9765-01556c601ff3 req-b6be6747-6d67-4ac7-befe-a4959502b3eb service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-f9a4a6cb-820c-46ad-b8cd-21b255488ee5 req-cfad5ab2-7041-4ac1-b6d8-ff76e4cae50e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-changed-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Refreshing instance network info cache due to event network-changed-96d957d1-d716-4bf2-8cc9-513ce4817d0c. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Acquiring lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Acquired lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Refreshing network info cache for port 96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-6952084b-877b-45fb-8046-c9ac598ddec4 req-2930cab4-920b-4321-9aae-c196b82b84ef service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-7fca74a9-6754-462a-9a5f-b0260c2754b7 req-6b7b6e18-35e5-4aea-8157-9948a7c1eb25 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-d6c49415-b05f-4fd7-933d-5df0d18f8d0c req-b5354000-b791-4639-b056-bd1dc05d422b service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.compute.manager [req-f9ab76a8-517e-4354-a1c1-dd8c49dd9d00 req-adccf09c-0a04-4041-ac17-a1fb30360b90 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 for instance with vm_state building and task_state spawning.
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Snapshot extracted, beginning image upload
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance destroyed successfully.
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance spawned successfully.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:24 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=6930MB free_disk=25.824146270751953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lazy-loading 'flavor' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475784.316936, 259fd1d1-10f6-443e-ac1a-2824ee3c04fc => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] VM Started (Lifecycle Event)
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:36:24 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:36:24 user nova-compute[71026]:   <source dev="/dev/sdh"/>
Jul 27 16:36:24 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:36:24 user nova-compute[71026]:   <serial>88c3e20b-35bc-4c84-b3df-8129325a3bbf</serial>
Jul 27 16:36:24 user nova-compute[71026]: </disk>
Jul 27 16:36:24 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-changed-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Refreshing instance network info cache due to event network-changed-dbd736b7-dabf-4687-845b-afd30024718d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Refreshing network info cache for port dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:24 user nova-compute[71026]: INFO nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Took 14.76 seconds to spawn the instance on the hypervisor.
Jul 27 16:36:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:21:2e:1c, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance cec98ede-1131-4669-9e61-c10b291150f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4256bebd-a216-46e4-acd9-fa7fe38422cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d79cf19e-8872-4bf6-ac21-3832ce196f1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance f0e1f730-6df4-44b8-b794-44a80ccefd06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:25 user nova-compute[71026]: INFO nova.compute.manager [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Took 41.38 seconds to build instance.
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Releasing lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:25 user nova-compute[71026]: WARNING nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 for instance with vm_state building and task_state spawning.
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.014s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:25 user nova-compute[71026]: WARNING nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 for instance with vm_state building and task_state spawning.
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:25 user nova-compute[71026]: WARNING nova.compute.manager [req-0d9d15ac-e12c-4099-a75a-38d365d0c39e req-55d63918-9c25-4829-a7d0-3169aefe93e0 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 for instance with vm_state building and task_state spawning.
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquired lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ba1c5664-1d56-43e5-9547-2215004e612e tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.534s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] No VIF found with MAC fa:16:3e:9a:df:62, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c9e1bf1c-a645-439c-805b-594504cc56e6 tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.097s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.102s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updated VIF entry in instance network info cache for port dbd736b7-dabf-4687-845b-afd30024718d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-71ce266b-f846-4290-a5de-1975035c617a req-6bd75d50-d4dd-463b-a03b-ae4dfe422fe5 service nova] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Updating instance_info_cache with network_info: [{"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Releasing lock "refresh_cache-f0e1f730-6df4-44b8-b794-44a80ccefd06" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance network_info: |[{"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Start _get_guest_xml network_info=[{"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:36:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088306929',display_name='tempest-ServersNegativeTestJSON-server-1088306929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088306929',id=12,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-55riutbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:36:18Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=f0e1f730-6df4-44b8-b794-44a80ccefd06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'pci_devices' on Instance uuid f0e1f730-6df4-44b8-b794-44a80ccefd06 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:36:26 user nova-compute[71026]:   <uuid>f0e1f730-6df4-44b8-b794-44a80ccefd06</uuid>
Jul 27 16:36:26 user nova-compute[71026]:   <name>instance-0000000c</name>
Jul 27 16:36:26 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:36:26 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:36:26 user nova-compute[71026]:   <metadata>
Jul 27 16:36:26 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:36:26 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:name>tempest-ServersNegativeTestJSON-server-1088306929</nova:name>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:36:26</nova:creationTime>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:36:26 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:36:26 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:owner>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:user uuid="0ce09c32af684da283531bdabc3e15a7">tempest-ServersNegativeTestJSON-1653924088-project-member</nova:user>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:project uuid="861424cabfc04dcd801426788ce536d3">tempest-ServersNegativeTestJSON-1653924088</nova:project>
Jul 27 16:36:26 user nova-compute[71026]:       </nova:owner>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:36:26 user nova-compute[71026]:       <nova:ports>
Jul 27 16:36:26 user nova-compute[71026]:         <nova:port uuid="96d957d1-d716-4bf2-8cc9-513ce4817d0c">
Jul 27 16:36:26 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:36:26 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:26 user nova-compute[71026]:       </nova:ports>
Jul 27 16:36:26 user nova-compute[71026]:     </nova:instance>
Jul 27 16:36:26 user nova-compute[71026]:   </metadata>
Jul 27 16:36:26 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:36:26 user nova-compute[71026]:     <system>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="serial">f0e1f730-6df4-44b8-b794-44a80ccefd06</entry>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="uuid">f0e1f730-6df4-44b8-b794-44a80ccefd06</entry>
Jul 27 16:36:26 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:36:26 user nova-compute[71026]:     </system>
Jul 27 16:36:26 user nova-compute[71026]:   </sysinfo>
Jul 27 16:36:26 user nova-compute[71026]:   <os>
Jul 27 16:36:26 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:36:26 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:36:26 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:36:26 user nova-compute[71026]:   </os>
Jul 27 16:36:26 user nova-compute[71026]:   <features>
Jul 27 16:36:26 user nova-compute[71026]:     <acpi/>
Jul 27 16:36:26 user nova-compute[71026]:     <apic/>
Jul 27 16:36:26 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:36:26 user nova-compute[71026]:   </features>
Jul 27 16:36:26 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:36:26 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:36:26 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:36:26 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:36:26 user nova-compute[71026]:   </clock>
Jul 27 16:36:26 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:36:26 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:36:26 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:36:26 user nova-compute[71026]:   </cpu>
Jul 27 16:36:26 user nova-compute[71026]:   <devices>
Jul 27 16:36:26 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:36:26 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:36:26 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk"/>
Jul 27 16:36:26 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:36:26 user nova-compute[71026]:     </disk>
Jul 27 16:36:26 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:26 user nova-compute[71026]:       <mac address="fa:16:3e:2b:2f:43"/>
Jul 27 16:36:26 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:26 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:26 user nova-compute[71026]:       <target dev="tap96d957d1-d7"/>
Jul 27 16:36:26 user nova-compute[71026]:     </interface>
Jul 27 16:36:26 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:36:26 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/console.log" append="off"/>
Jul 27 16:36:26 user nova-compute[71026]:     </serial>
Jul 27 16:36:26 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:36:26 user nova-compute[71026]:     <video>
Jul 27 16:36:26 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:26 user nova-compute[71026]:     </video>
Jul 27 16:36:26 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:36:26 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:36:26 user nova-compute[71026]:     </rng>
Jul 27 16:36:26 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:36:26 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:36:26 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:36:26 user nova-compute[71026]:     </memballoon>
Jul 27 16:36:26 user nova-compute[71026]:   </devices>
Jul 27 16:36:26 user nova-compute[71026]: </domain>
Jul 27 16:36:26 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088306929',display_name='tempest-ServersNegativeTestJSON-server-1088306929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088306929',id=12,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-55riutbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:36:18Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=f0e1f730-6df4-44b8-b794-44a80ccefd06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG os_vif [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d957d1-d7, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96d957d1-d7, col_values=(('external_ids', {'iface-id': '96d957d1-d716-4bf2-8cc9-513ce4817d0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:2f:43', 'vm-uuid': 'f0e1f730-6df4-44b8-b794-44a80ccefd06'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: INFO os_vif [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7')
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] No VIF found with MAC fa:16:3e:2b:2f:43, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:26 user nova-compute[71026]: INFO nova.compute.manager [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Terminating instance
Jul 27 16:36:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-52a3f899-4c29-47e2-8ec3-477c5bd63b49 req-9a3b47cf-61ec-4f29-802b-18b77d03ec58 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:27 user nova-compute[71026]: WARNING nova.compute.manager [req-a8947943-8d4d-4ead-83fd-54355960e699 req-aa00435c-e152-4f6e-804c-10affc52a647 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state active and task_state rescuing.
Jul 27 16:36:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Snapshot image upload complete
Jul 27 16:36:28 user nova-compute[71026]: INFO nova.compute.manager [None req-bcf2fe41-ad0f-4ead-859d-eda7950f04a3 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Took 12.43 seconds to snapshot the instance on the hypervisor.
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Instance destroyed successfully.
Jul 27 16:36:28 user nova-compute[71026]: DEBUG nova.objects.instance [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lazy-loading 'resources' on Instance uuid cec98ede-1131-4669-9e61-c10b291150f6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-512513718',display_name='tempest-DeleteServersTestJSON-server-512513718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-512513718',id=1,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33406744ea1f45ff815dd0f9a5278d15',ramdisk_id='',reservation_id='r-ullcmo9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-120381400',owner_user_name='tempest-DeleteServersTestJSON-120381400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:34:29Z,user_data=None,user_id='688ffec95bc74058b2ff385deba277c5',uuid=cec98ede-1131-4669-9e61-c10b291150f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converting VIF {"id": "056e2800-044c-458f-98ff-2b1f265bd6f4", "address": "fa:16:3e:9a:df:62", "network": {"id": "7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-839162665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33406744ea1f45ff815dd0f9a5278d15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap056e2800-04", "ovs_interfaceid": "056e2800-044c-458f-98ff-2b1f265bd6f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_vif [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap056e2800-04, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:28 user nova-compute[71026]: INFO os_vif [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:df:62,bridge_name='br-int',has_traffic_filtering=True,id=056e2800-044c-458f-98ff-2b1f265bd6f4,network=Network(7b86eba7-2ad9-4013-8fb7-cb5b5d3ea16e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap056e2800-04')
Jul 27 16:36:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqkArLib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:28 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a85c45-bc62-4471-a894-b558081a3017]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:36:28 user nova-compute[71026]: No targets found.
Jul 27 16:36:28 user nova-compute[71026]: iSNS:
Jul 27 16:36:28 user nova-compute[71026]: No targets found.
Jul 27 16:36:28 user nova-compute[71026]: STATIC:
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:36:28 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:36:28 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:36:28 user nova-compute[71026]: FIRMWARE:
Jul 27 16:36:28 user nova-compute[71026]: No targets found.
Jul 27 16:36:28 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:36:28 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:36:28 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ba153-98af-480d-ba00-94657002ddd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9b0b6-a218-4e4f-bd0e-dca53f5616f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)
Jul 27 16:36:28 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:28 user nova-compute[71026]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf (non-flash)
Jul 27 16:36:28 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885e8af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf'): ({'sdh'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Removing single pathed devices sdh {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1734d744-4900-4dea-bdf4-d76bbdba4083]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75bd547-44e2-46e6-8fd9-60faa29f4245]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Flushing IO for device /dev/sdh {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:36:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec294c5-24cd-433b-ab99-7cc77cd4a8b4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.060s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb5b50-5b77-49f6-9687-e7df4fefb3bf]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618ae07-2e88-459f-8a7f-beef3213280c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ecc14a-6629-429d-a335-0d238d2a71df]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260]
Jul 27 16:36:29 user nova-compute[71026]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:29 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:29 user nova-compute[71026]: WARNING nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state deleting.
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:29 user nova-compute[71026]: WARNING nova.compute.manager [req-84e79fbd-ece5-4687-8380-b8f4c1f0e25e req-92bfcf19-2dbe-4bd5-b2f5-c45307459526 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state deleting.
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c3e20b-35bc-4c84-b3df-8129325a3bbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1f4257-c19f-43b7-95d4-076a3aad2d0f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] <== disconnect_volume: return (481ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:36:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Deleting instance files /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6_del
Jul 27 16:36:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Deletion of /opt/stack/data/nova/instances/cec98ede-1131-4669-9e61-c10b291150f6_del complete
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: INFO nova.compute.manager [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Took 2.78 seconds to destroy the instance on the hypervisor.
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:29 user nova-compute[71026]: WARNING nova.compute.manager [req-8522b11e-4585-4feb-bd81-f6b6a4e9056c req-b6937606-25bb-40fd-852d-cf79b5e13f89 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state active and task_state rescuing.
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:30 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Took 0.94 seconds to deallocate network for instance.
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475790.945826, d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:30 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] VM Resumed (Lifecycle Event)
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-90531601-204a-446b-974e-51922488c927 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475790.952291, d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] VM Started (Lifecycle Event)
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Took 0.95 seconds to detach 1 volumes for instance.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:31 user nova-compute[71026]: WARNING nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state deleting.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-unplugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Acquiring lock "cec98ede-1131-4669-9e61-c10b291150f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "cec98ede-1131-4669-9e61-c10b291150f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] No waiting events found dispatching network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:31 user nova-compute[71026]: WARNING nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received unexpected event network-vif-plugged-056e2800-044c-458f-98ff-2b1f265bd6f4 for instance with vm_state active and task_state deleting.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] No waiting events found dispatching network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:31 user nova-compute[71026]: WARNING nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received unexpected event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c for instance with vm_state building and task_state spawning.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] No waiting events found dispatching network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:36:31 user nova-compute[71026]: WARNING nova.compute.manager [req-1dac6036-9b07-423e-9489-fe589ddf7d2a req-ec33b34f-5e1e-41ab-a7db-76a495f8f207 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received unexpected event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c for instance with vm_state building and task_state spawning.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-2235b1f5-fe8d-4ba2-9860-2375149e3a5e req-5e43a25b-589f-4bcc-adb5-73835c7d2ea6 service nova] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Received event network-vif-deleted-056e2800-044c-458f-98ff-2b1f265bd6f4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475791.7828586, f0e1f730-6df4-44b8-b794-44a80ccefd06 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] VM Resumed (Lifecycle Event)
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance spawned successfully.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475791.7849858, f0e1f730-6df4-44b8-b794-44a80ccefd06 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] VM Started (Lifecycle Event)
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:31 user nova-compute[71026]: INFO nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Took 14.03 seconds to spawn the instance on the hypervisor.
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:36:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:36:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:36:32 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:36:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.669s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:32 user nova-compute[71026]: INFO nova.compute.manager [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Took 16.07 seconds to build instance.
Jul 27 16:36:32 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Deleted allocations for instance cec98ede-1131-4669-9e61-c10b291150f6
Jul 27 16:36:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f839b555-ef62-482a-8b2a-7805999c60e9 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.270s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-27fd397b-0174-44d3-8012-4b61f9c085fa tempest-DeleteServersTestJSON-120381400 tempest-DeleteServersTestJSON-120381400-project-member] Lock "cec98ede-1131-4669-9e61-c10b291150f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.670s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:43 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475788.735238, cec98ede-1131-4669-9e61-c10b291150f6 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:36:43 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: cec98ede-1131-4669-9e61-c10b291150f6] VM Stopped (Lifecycle Event)
Jul 27 16:36:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d6c0e748-6409-4e5b-87fd-b0aa6c43c36a None None] [instance: cec98ede-1131-4669-9e61-c10b291150f6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:36:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-changed-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Refreshing instance network info cache due to event network-changed-cc879d42-a438-41cb-9396-68694bf1c160. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] Acquiring lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] Acquired lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Refreshing network info cache for port cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updated VIF entry in instance network info cache for port cc879d42-a438-41cb-9396-68694bf1c160. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating instance_info_cache with network_info: [{"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-changed-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Refreshing instance network info cache due to event network-changed-d6ecd5de-a988-469b-b180-682819d64f45. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] Acquiring lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] Acquired lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Refreshing network info cache for port d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1b7a0467-576f-4948-97c3-beeaa6678029 req-39f0a34d-9443-41d7-9487-2f3efb76c96a service nova] Releasing lock "refresh_cache-3d7e58a9-6acf-4584-bb38-1d88d536ed63" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updated VIF entry in instance network info cache for port d6ecd5de-a988-469b-b180-682819d64f45. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updating instance_info_cache with network_info: [{"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-abed77b7-18bb-43b3-9b3c-f2d0bfd77e61 req-2a334bef-48fa-4d2c-9b72-1ec73864007f service nova] Releasing lock "refresh_cache-8243a940-bb67-45c5-ad47-4364a23b5cd9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'flavor' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:50 user nova-compute[71026]: INFO nova.compute.manager [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Attaching volume 672804ee-704c-4f0f-aad2-abffb9c8150c to /dev/sdc
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'flavor' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f80688d-96f6-4f3c-8412-b9785af039d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c528b-73ce-4029-b5e8-a7314b97cad0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4113cde6-cb2b-47b3-a1bd-9560fff52db9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc37755-7abb-4778-a993-8f77d8b0f630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:50 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[944108d6-4b8c-4eb3-9c52-d36c63b54eb9]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating existing volume attachment record: 4f0e8dbe-4dd5-43c3-bbcd-1f1e09b411c2 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.159s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:50 user nova-compute[71026]: INFO nova.compute.manager [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Attaching volume e68472ef-bdd0-4bc9-8677-3579eff0a36e to /dev/vdb
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.utils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d36938-670e-4a43-891a-6c6e7919d3d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe755880-fd98-4323-9fab-864bb9e5997f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1345e-4abd-41d8-b0bc-1cd5f67d31e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[624423e2-cc27-4e49-9807-466e0816852c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:51 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:36:51 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab6568-1ee8-4cbc-b753-7caec9b0463b]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG os_brick.utils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:51 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updating existing volume attachment record: 2b6403e7-87c0-4b4b-b0aa-8547b12b245b {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-changed-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Refreshing instance network info cache due to event network-changed-1e50cdea-515a-49c8-8d7b-264e6cd04cd0. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] Acquiring lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] Acquired lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Refreshing network info cache for port 1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'flavor' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:53 user nova-compute[71026]: INFO nova.compute.manager [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attaching volume 60c071d3-854e-4682-aad6-4f9e2d33f389 to /dev/vdb
Jul 27 16:36:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updated VIF entry in instance network info cache for port 1e50cdea-515a-49c8-8d7b-264e6cd04cd0. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updating instance_info_cache with network_info: [{"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ca9bc8f-115e-4ab4-ae2d-fbe45f7935f6 req-3f65a026-20e6-4626-bd08-944528fd3910 service nova] Releasing lock "refresh_cache-4256bebd-a216-46e4-acd9-fa7fe38422cd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.utils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79370a87-78fd-46a4-8861-797d0254ddbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bae01-1e3a-4fdb-a248-392599558353]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab24562-7cd9-4eef-8949-b9eb2047b99e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c18a22-1ae5-4d17-b7cd-ca18484ce96e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:36:53 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:36:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9cb20-e90d-4a5d-9637-cfd25ad33009]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG os_brick.utils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updating existing volume attachment record: bcb8bbb5-7278-4741-9577-49dcc9848c57 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:36:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:36:55 user nova-compute[71026]: INFO nova.compute.claims [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Claim successful on node user
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:36:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.policy [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76eb24d0cfe34fe3915c2f23b4b367ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f47223aec7b4b5aae9d48c87258be18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:36:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Creating image(s)
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "/opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "/opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.037s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.195s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk 1073741824" returned: 0 in 0.050s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Successfully created port: 1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Cannot resize image /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'migration_context' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Ensure instance console log exists: /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:36:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Successfully updated port: 1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquired lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-changed-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Refreshing instance network info cache due to event network-changed-1c085f61-f6ff-4884-baab-101092898a1a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] Acquiring lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating instance_info_cache with network_info: [{"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Releasing lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Instance network_info: |[{"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] Acquired lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Refreshing network info cache for port 1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Start _get_guest_xml network_info=[{"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:36:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1071598303',display_name='tempest-SnapshotDataIntegrityTests-server-1071598303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1071598303',id=13,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4wGkxZUU42gP9ZD3LsxJAyuoLsX8Cv8S23sxBR98U7w6dP2zla0kxW3o3Y6MRU4QeCaWo+5fqMTOsYfjkeRbnRl5yCmZU1LvwYDOx50f8pB81HXsQ9WsHJ3o/5KdeNTw==',key_name='tempest-keypair-1865012223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f47223aec7b4b5aae9d48c87258be18',ramdisk_id='',reservation_id='r-ufdxr0u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1287739161',owner_user_name='tempest-SnapshotDataIntegrityTests-1287739161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76eb24d0cfe34fe3915c2f23b4b367ae',uuid=e6154c2b-855a-4baf-b3e0-e1dee76110b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converting VIF {"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'pci_devices' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:36:58 user nova-compute[71026]:   <uuid>e6154c2b-855a-4baf-b3e0-e1dee76110b7</uuid>
Jul 27 16:36:58 user nova-compute[71026]:   <name>instance-0000000d</name>
Jul 27 16:36:58 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:36:58 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:36:58 user nova-compute[71026]:   <metadata>
Jul 27 16:36:58 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:36:58 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1071598303</nova:name>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:36:58</nova:creationTime>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:36:58 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:36:58 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:owner>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:user uuid="76eb24d0cfe34fe3915c2f23b4b367ae">tempest-SnapshotDataIntegrityTests-1287739161-project-member</nova:user>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:project uuid="4f47223aec7b4b5aae9d48c87258be18">tempest-SnapshotDataIntegrityTests-1287739161</nova:project>
Jul 27 16:36:58 user nova-compute[71026]:       </nova:owner>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:36:58 user nova-compute[71026]:       <nova:ports>
Jul 27 16:36:58 user nova-compute[71026]:         <nova:port uuid="1c085f61-f6ff-4884-baab-101092898a1a">
Jul 27 16:36:58 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 16:36:58 user nova-compute[71026]:         </nova:port>
Jul 27 16:36:58 user nova-compute[71026]:       </nova:ports>
Jul 27 16:36:58 user nova-compute[71026]:     </nova:instance>
Jul 27 16:36:58 user nova-compute[71026]:   </metadata>
Jul 27 16:36:58 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:36:58 user nova-compute[71026]:     <system>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="serial">e6154c2b-855a-4baf-b3e0-e1dee76110b7</entry>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="uuid">e6154c2b-855a-4baf-b3e0-e1dee76110b7</entry>
Jul 27 16:36:58 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:36:58 user nova-compute[71026]:     </system>
Jul 27 16:36:58 user nova-compute[71026]:   </sysinfo>
Jul 27 16:36:58 user nova-compute[71026]:   <os>
Jul 27 16:36:58 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:36:58 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:36:58 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:36:58 user nova-compute[71026]:   </os>
Jul 27 16:36:58 user nova-compute[71026]:   <features>
Jul 27 16:36:58 user nova-compute[71026]:     <acpi/>
Jul 27 16:36:58 user nova-compute[71026]:     <apic/>
Jul 27 16:36:58 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:36:58 user nova-compute[71026]:   </features>
Jul 27 16:36:58 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:36:58 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:36:58 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:36:58 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:36:58 user nova-compute[71026]:   </clock>
Jul 27 16:36:58 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:36:58 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:36:58 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:36:58 user nova-compute[71026]:   </cpu>
Jul 27 16:36:58 user nova-compute[71026]:   <devices>
Jul 27 16:36:58 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:36:58 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:36:58 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk"/>
Jul 27 16:36:58 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:36:58 user nova-compute[71026]:     </disk>
Jul 27 16:36:58 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:36:58 user nova-compute[71026]:       <mac address="fa:16:3e:70:6e:3a"/>
Jul 27 16:36:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:58 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:36:58 user nova-compute[71026]:       <target dev="tap1c085f61-f6"/>
Jul 27 16:36:58 user nova-compute[71026]:     </interface>
Jul 27 16:36:58 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:36:58 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/console.log" append="off"/>
Jul 27 16:36:58 user nova-compute[71026]:     </serial>
Jul 27 16:36:58 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:36:58 user nova-compute[71026]:     <video>
Jul 27 16:36:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:36:58 user nova-compute[71026]:     </video>
Jul 27 16:36:58 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:36:58 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:36:58 user nova-compute[71026]:     </rng>
Jul 27 16:36:58 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:36:58 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:36:58 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:36:58 user nova-compute[71026]:     </memballoon>
Jul 27 16:36:58 user nova-compute[71026]:   </devices>
Jul 27 16:36:58 user nova-compute[71026]: </domain>
Jul 27 16:36:58 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1071598303',display_name='tempest-SnapshotDataIntegrityTests-server-1071598303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1071598303',id=13,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4wGkxZUU42gP9ZD3LsxJAyuoLsX8Cv8S23sxBR98U7w6dP2zla0kxW3o3Y6MRU4QeCaWo+5fqMTOsYfjkeRbnRl5yCmZU1LvwYDOx50f8pB81HXsQ9WsHJ3o/5KdeNTw==',key_name='tempest-keypair-1865012223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f47223aec7b4b5aae9d48c87258be18',ramdisk_id='',reservation_id='r-ufdxr0u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1287739161',owner_user_name='tempest-SnapshotDataIntegrityTests-1287739161-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:36:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76eb24d0cfe34fe3915c2f23b4b367ae',uuid=e6154c2b-855a-4baf-b3e0-e1dee76110b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converting VIF {"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_vif [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c085f61-f6, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c085f61-f6, col_values=(('external_ids', {'iface-id': '1c085f61-f6ff-4884-baab-101092898a1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:6e:3a', 'vm-uuid': 'e6154c2b-855a-4baf-b3e0-e1dee76110b7'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:36:58 user nova-compute[71026]: INFO os_vif [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6')
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No VIF found with MAC fa:16:3e:70:6e:3a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omsKiljN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:58 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:58 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:36:58 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da584f-9311-42b7-bfb0-17ee2525d994]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:36:58 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5386f2-2e59-43ef-8b10-11c686b61ba3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c] added
Jul 27 16:36:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a8d2fb-a025-45b6-822d-14ea1ef21940]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[425331bd-44eb-4c54-b4e0-42b4e428527d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omsKiljN {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updated VIF entry in instance network info cache for port 1c085f61-f6ff-4884-baab-101092898a1a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating instance_info_cache with network_info: [{"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v omsKiljN" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53034085-b035-42ae-87ae-56170ab6b21c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'omsKiljN'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b0d5cb1a-e155-4155-8d5f-6e31fce22abd req-0d8d576f-46a2-419c-83af-7e12c62b58f3 service nova] Releasing lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd65990-ed7a-41bc-9fe7-fd73dbd445d9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c6ca52-804f-438f-8610-6d183e2cc9e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e7ee6a-d74b-437e-87c9-464c1f415ff2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260]
Jul 27 16:36:59 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260] successful.
Jul 27 16:36:59 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e11a7-74b5-48d1-a0c6-7643a1a24feb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38d675-86bd-4557-8e70-73c1376ce32a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:36:59 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:36:59 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:36:59 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3e0b76-2794-40ac-9723-aa3721fe057b]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omsKiljN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKzYehWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:36:59 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:36:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26135363737363438', 'path': '/dev/sdh'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135363737363438', 'path': '/dev/sdh'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.824s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:00 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:00 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.objects.instance [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'flavor' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a07c3-2d7f-459d-a8fe-d2a2f3782ac5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:37:00 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:37:00 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:00 user nova-compute[71026]:   <source dev="/dev/sdh"/>
Jul 27 16:37:00 user nova-compute[71026]:   <target dev="sdc" bus="scsi"/>
Jul 27 16:37:00 user nova-compute[71026]:   <serial>672804ee-704c-4f0f-aad2-abffb9c8150c</serial>
Jul 27 16:37:00 user nova-compute[71026]:   <address type="drive" controller="0" unit="2"/>
Jul 27 16:37:00 user nova-compute[71026]: </disk>
Jul 27 16:37:00 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aaefa3-9f78-413d-80d8-61eb0a633e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e] added
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c2fe65-7c62-47a3-971a-6514c5d4935b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a192ab11-6121-4299-a423-1557b7e9b05e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKzYehWL {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKzYehWL" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42ce03e-a229-4666-a0f3-a097085c7932]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKzYehWL'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce43b3f-be8e-4e51-a44e-2088f3c77b63]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aeb8e0-a7c2-47b6-9858-8504b1dd8ca0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d512f-a922-466d-9f39-4106424a9d07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260]
Jul 27 16:37:00 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[759530cf-6c97-43c3-8aef-3943fd02116e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e478d955-8b14-4fe9-b554-6c1b81a9b92c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:00 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf8eeef-0bfb-498d-b5cb-bea7cc4004a7]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKzYehWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] No waiting events found dispatching network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:00 user nova-compute[71026]: WARNING nova.compute.manager [req-fc9a9f33-977b-4784-94ef-b779c4829043 req-f136ddae-2aa8-431f-900f-53cab41f2f95 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received unexpected event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a for instance with vm_state building and task_state spawning.
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No BDM found with device name sda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] No VIF found with MAC fa:16:3e:43:a4:24, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e6983d-e161-40db-820c-0794e5048393 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.464s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] <== connect_volume: return (2285ms) {'type': 'block', 'scsi_wwn': '26363313133646132', 'path': '/dev/sdi'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363313133646132', 'path': '/dev/sdi'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'flavor' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:37:01 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:01 user nova-compute[71026]:   <source dev="/dev/sdi"/>
Jul 27 16:37:01 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:01 user nova-compute[71026]:   <serial>e68472ef-bdd0-4bc9-8677-3579eff0a36e</serial>
Jul 27 16:37:01 user nova-compute[71026]: </disk>
Jul 27 16:37:01 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:01 user nova-compute[71026]: INFO nova.compute.manager [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Detaching volume 672804ee-704c-4f0f-aad2-abffb9c8150c
Jul 27 16:37:01 user nova-compute[71026]: INFO nova.virt.block_device [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Attempting to driver detach volume 672804ee-704c-4f0f-aad2-abffb9c8150c from mountpoint /dev/sdc
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Attempting to detach device sdc from instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:01 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:01 user nova-compute[71026]:   <source dev="/dev/sdh"/>
Jul 27 16:37:01 user nova-compute[71026]:   <target dev="sdc" bus="scsi"/>
Jul 27 16:37:01 user nova-compute[71026]:   <serial>672804ee-704c-4f0f-aad2-abffb9c8150c</serial>
Jul 27 16:37:01 user nova-compute[71026]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 16:37:01 user nova-compute[71026]: </disk>
Jul 27 16:37:01 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Successfully detached device sdc from instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 from the persistent domain config.
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:01 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:01 user nova-compute[71026]:   <source dev="/dev/sdh"/>
Jul 27 16:37:01 user nova-compute[71026]:   <target dev="sdc" bus="scsi"/>
Jul 27 16:37:01 user nova-compute[71026]:   <serial>672804ee-704c-4f0f-aad2-abffb9c8150c</serial>
Jul 27 16:37:01 user nova-compute[71026]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 27 16:37:01 user nova-compute[71026]: </disk>
Jul 27 16:37:01 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:01 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:01 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:01 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b9f72f-0062-42ee-a931-37413f1c283d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:37:01 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[823373e9-fedf-430a-9a6b-a4d3256bdb61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389] added
Jul 27 16:37:01 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc8d8c-3c32-45de-8899-e908fd059855]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e3fe5-4f5a-41a7-9c0d-af91b10e248f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgnJIlRi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgnJIlRi" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[214ae42b-baad-42f8-8d18-75e6813de978]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zgnJIlRi'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89f6e1a-a7a1-4886-99a7-b7727217920d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42318e0-a71a-4701-b33b-b7419c7005ee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No VIF found with MAC fa:16:3e:16:be:b4, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc63a2f-4aef-494f-a1d0-5805098e0cb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]
Jul 27 16:37:02 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf871c-2d50-49c7-bb71-e68ee840504b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf12498-bc40-478c-85a4-266798da48d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:02 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69eedc9-0e1d-45e1-8c6d-410b2876e38f]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a05233b0-4114-460c-a3ec-208ae795b421 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.345s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690475822.3546515, 3d7e58a9-6acf-4584-bb38-1d88d536ed63 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Successfully detached device sdc from instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 from the live domain config.
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'omsKiljN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:02 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] No waiting events found dispatching network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:02 user nova-compute[71026]: WARNING nova.compute.manager [req-cfe9cf27-769a-4c2b-a112-b0cef3c6d3a8 req-d2d8d8a3-05ee-4c77-aaee-ea26bfb378b9 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received unexpected event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a for instance with vm_state building and task_state spawning.
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475822.8558302, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] VM Resumed (Lifecycle Event)
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Instance spawned successfully.
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475822.858721, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] VM Started (Lifecycle Event)
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:37:02 user nova-compute[71026]: INFO nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Took 6.45 seconds to spawn the instance on the hypervisor.
Jul 27 16:37:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:03 user nova-compute[71026]: INFO nova.compute.manager [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Detaching volume e68472ef-bdd0-4bc9-8677-3579eff0a36e
Jul 27 16:37:03 user nova-compute[71026]: INFO nova.compute.manager [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Took 7.43 seconds to build instance.
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b6f18c3c-c40f-4a0f-9985-32d0dd623894 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.533s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:03 user nova-compute[71026]: INFO nova.virt.block_device [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Attempting to driver detach volume e68472ef-bdd0-4bc9-8677-3579eff0a36e from mountpoint /dev/vdb
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Attempting to detach device vdb from instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:03 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:03 user nova-compute[71026]:   <source dev="/dev/sdi"/>
Jul 27 16:37:03 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:03 user nova-compute[71026]:   <serial>e68472ef-bdd0-4bc9-8677-3579eff0a36e</serial>
Jul 27 16:37:03 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:37:03 user nova-compute[71026]: </disk>
Jul 27 16:37:03 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully detached device vdb from instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 from the persistent domain config.
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:03 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:03 user nova-compute[71026]:   <source dev="/dev/sdi"/>
Jul 27 16:37:03 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:03 user nova-compute[71026]:   <serial>e68472ef-bdd0-4bc9-8677-3579eff0a36e</serial>
Jul 27 16:37:03 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:37:03 user nova-compute[71026]: </disk>
Jul 27 16:37:03 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '26231306137306430', 'path': '/dev/sdj'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231306137306430', 'path': '/dev/sdj'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.884s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'flavor' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3333a23-c21f-452f-8fa4-da9c4c32200b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:03 user nova-compute[71026]: No targets found.
Jul 27 16:37:03 user nova-compute[71026]: iSNS:
Jul 27 16:37:03 user nova-compute[71026]: No targets found.
Jul 27 16:37:03 user nova-compute[71026]: STATIC:
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:03 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:03 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:03 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:03 user nova-compute[71026]: No targets found.
Jul 27 16:37:03 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:03 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:03 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:37:03 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:03 user nova-compute[71026]:   <source dev="/dev/sdj"/>
Jul 27 16:37:03 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:03 user nova-compute[71026]:   <serial>60c071d3-854e-4682-aad6-4f9e2d33f389</serial>
Jul 27 16:37:03 user nova-compute[71026]: </disk>
Jul 27 16:37:03 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467b6cc-7d96-46d1-8963-759f26be607a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314b373-a4f8-441e-a5c9-d667c552ee9c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:03 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:03 user nova-compute[71026]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c (non-flash)
Jul 27 16:37:03 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80d5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c'): ({'sdh'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Removing single pathed devices sdh {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f6a893-bc31-4b53-b4e1-946a8f19762c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c7bd5b-6f5e-4d5c-b5fd-a01b60e96cbe]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Flushing IO for device /dev/sdh {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa007df4-8275-40b5-b3ae-cdb8becf39e9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5167485d-fcb2-4ecc-af34-1554a692b430]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdfc538-a06f-407b-a668-5c7b2fbd0eef]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11eea22-9349-41c2-8bee-a80e9d8024c2]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260]
Jul 27 16:37:03 user nova-compute[71026]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:03 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:672804ee-704c-4f0f-aad2-abffb9c8150c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5067a357-31b5-46b0-9cf8-a33b15cf7ad1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] <== disconnect_volume: return (1285ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] No VIF found with MAC fa:16:3e:0d:be:0d, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:37:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4ba867d4-a600-4fba-99a9-07c509fee820 tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.766s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690475824.0577648, 8243a940-bb67-45c5-ad47-4364a23b5cd9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:37:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully detached device vdb from instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 from the live domain config.
Jul 27 16:37:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKzYehWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:04 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e41d74-d697-4a64-9f79-4b9be8b78da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:04 user nova-compute[71026]: No targets found.
Jul 27 16:37:04 user nova-compute[71026]: iSNS:
Jul 27 16:37:04 user nova-compute[71026]: No targets found.
Jul 27 16:37:04 user nova-compute[71026]: STATIC:
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:04 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:04 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:04 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:04 user nova-compute[71026]: No targets found.
Jul 27 16:37:04 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:04 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:04 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2a3a12-7eb4-49d4-af5d-0a1efb98bd50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[065e2d3d-64f3-4198-af85-8162570868ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:04 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80d7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e'): ({'sdi'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Removing single pathed devices sdi {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c7675-6793-4a4d-a31a-d24174babc0a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76884f1-0622-4f0c-8ceb-643f8f51d893]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Flushing IO for device /dev/sdi {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d27ad6-a28e-4618-9252-88f8017590d2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b73006-0623-4d32-a956-3e4cbb736ccb]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] SCSI volumes sdi have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c06244-7dfe-4a76-8f3d-cf7892073ff8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd204e6-8325-4211-98a3-9b113cad6c53]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260]
Jul 27 16:37:04 user nova-compute[71026]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:04 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68472ef-bdd0-4bc9-8677-3579eff0a36e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27354a1-8194-4953-a771-fec0c02a15a1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] <== disconnect_volume: return (458ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'flavor' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f4c2d88d-f7eb-4c4e-b8db-62885aee0b97 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.981s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.utils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc45be92-99f0-42c4-b8c9-5b5b2fe8edb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1e45d-58dd-4907-b317-10396c9340e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a842ae-0141-4c28-a0d6-ca24af777ccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66447ccf-3368-46a3-a108-9f9e2e2a0935]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:37:05 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a26ce-622c-48c0-8c44-4f5e4604d2ab]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:05 user nova-compute[71026]: INFO nova.compute.manager [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Terminating instance
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG os_brick.utils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:05 user nova-compute[71026]: INFO nova.compute.manager [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Swapping volume 60c071d3-854e-4682-aad6-4f9e2d33f389 for 01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG nova.objects.instance [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'flavor' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3c90199a-c266-4636-b428-28a782ac7fce tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.746s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-unplugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] No waiting events found dispatching network-vif-unplugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-2cf005f8-b30e-427e-8a6b-c56a31fc9636 req-c3872f72-a07c-486c-8f5b-3e0f3b63f51f service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-unplugged-cc879d42-a438-41cb-9396-68694bf1c160 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Instance destroyed successfully.
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lazy-loading 'resources' on Instance uuid 3d7e58a9-6acf-4584-bb38-1d88d536ed63 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-199503615',display_name='tempest-AttachSCSIVolumeTestJSON-server-199503615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-199503615',id=7,image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/dlbiJbuKgyrsb8U3dpAD75aIbVSwTJs75OmR+LMNIDX+dKF9yjW4J+OnhzRPSy2Mt3UzJsQe6+TUXw731YpagDG9wW4UyQG+C9Zz0zJ/sLYOgjnh6al85v4iYN0M44A==',key_name='tempest-keypair-1858432515',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='494af5d25e76404bad17a4a968463dfe',ramdisk_id='',reservation_id='r-md5o40iy',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee293e36-8afd-41d3-9bcf-e3a98a54b121',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1537037127',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1537037127-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9a3f1bcf2a2451cba737f9a1ba47a3e',uuid=3d7e58a9-6acf-4584-bb38-1d88d536ed63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converting VIF {"id": "cc879d42-a438-41cb-9396-68694bf1c160", "address": "fa:16:3e:43:a4:24", "network": {"id": "437d5f8d-4677-45d2-acc7-ac58f87c3d6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1963138193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "494af5d25e76404bad17a4a968463dfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc879d42-a4", "ovs_interfaceid": "cc879d42-a438-41cb-9396-68694bf1c160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG os_vif [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc879d42-a4, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:06 user nova-compute[71026]: INFO os_vif [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:a4:24,bridge_name='br-int',has_traffic_filtering=True,id=cc879d42-a438-41cb-9396-68694bf1c160,network=Network(437d5f8d-4677-45d2-acc7-ac58f87c3d6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc879d42-a4')
Jul 27 16:37:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Deleting instance files /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63_del
Jul 27 16:37:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Deletion of /opt/stack/data/nova/instances/3d7e58a9-6acf-4584-bb38-1d88d536ed63_del complete
Jul 27 16:37:06 user nova-compute[71026]: INFO nova.compute.manager [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 27 16:37:06 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:37:06 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:37:07 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-cff9d09f-397f-4699-a5e8-907f8ce86dc0 req-856ebaa8-c342-4907-9e18-a40b96fdf265 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-deleted-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:08 user nova-compute[71026]: INFO nova.compute.manager [req-cff9d09f-397f-4699-a5e8-907f8ce86dc0 req-856ebaa8-c342-4907-9e18-a40b96fdf265 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Neutron deleted interface cc879d42-a438-41cb-9396-68694bf1c160; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.network.neutron [req-cff9d09f-397f-4699-a5e8-907f8ce86dc0 req-856ebaa8-c342-4907-9e18-a40b96fdf265 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:08 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Took 1.49 seconds to deallocate network for instance.
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-cff9d09f-397f-4699-a5e8-907f8ce86dc0 req-856ebaa8-c342-4907-9e18-a40b96fdf265 service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Detach interface failed, port_id=cc879d42-a438-41cb-9396-68694bf1c160, reason: Instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] Acquiring lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] No waiting events found dispatching network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:08 user nova-compute[71026]: WARNING nova.compute.manager [req-fa780a93-33b3-4a26-be74-1ae720e3f7b6 req-37b62d87-6937-4ff6-8f6c-4125a160b5fd service nova] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Received unexpected event network-vif-plugged-cc879d42-a438-41cb-9396-68694bf1c160 for instance with vm_state active and task_state deleting.
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:08 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Deleted allocations for instance 3d7e58a9-6acf-4584-bb38-1d88d536ed63
Jul 27 16:37:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1980105d-3c9a-44f3-a4dd-b3e33d059d25 tempest-AttachSCSIVolumeTestJSON-1537037127 tempest-AttachSCSIVolumeTestJSON-1537037127-project-member] Lock "3d7e58a9-6acf-4584-bb38-1d88d536ed63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.146s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd', 'serial': '01f786b8-2812-4967-a63d-a969672debbd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '60c071d3-854e-4682-aad6-4f9e2d33f389', 'serial'} {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:13 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b10fe7-e473-4aac-915d-9a7bd7a590ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:37:13 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e927db-ce9a-497f-a89b-6fc6aa429210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd] added
Jul 27 16:37:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773b65c-b2fc-47d4-8972-8599843d07e8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e4083-ecec-498c-a2e2-8f3fee91db61]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOoALsJw {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TOoALsJw" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca47eb-05ca-476a-a5cf-d47591f906d3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TOoALsJw'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09de991-84fe-4c74-b409-897b58bda4c9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a49ad-e9c5-411f-95a4-8f834f1d64e9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eda3000-ddfc-4574-9c69-7c771e0e9013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260]
Jul 27 16:37:14 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6bd071-5628-4292-9e12-87f21fcc5708]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588f531-b4c8-4c80-826f-688d3430b8c0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bbc9f-b6d3-4968-a21b-0351eefcaaef]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:15 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:37:15 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=6955MB free_disk=25.76888656616211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23663363135383631', 'path': '/dev/sdh'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663363135383631', 'path': '/dev/sdh'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.objects.instance [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lazy-loading 'flavor' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4256bebd-a216-46e4-acd9-fa7fe38422cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d79cf19e-8872-4bf6-ac21-3832ce196f1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance f0e1f730-6df4-44b8-b794-44a80ccefd06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:37:16 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 396361728 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:37:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 520093696 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:18 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 806354944 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 956301312 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e63b84-867a-4aa6-ab4e-34b041c38c79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:20 user nova-compute[71026]: No targets found.
Jul 27 16:37:20 user nova-compute[71026]: iSNS:
Jul 27 16:37:20 user nova-compute[71026]: No targets found.
Jul 27 16:37:20 user nova-compute[71026]: STATIC:
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:20 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:20 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:20 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:20 user nova-compute[71026]: No targets found.
Jul 27 16:37:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:20 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:20 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcff6e0-e3f5-493b-a40a-4f8b22f62c91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3221a-c8bf-48c3-b4b6-473337450acf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885e9510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389'): ({'sdj'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Removing single pathed devices sdj {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc7791-4d07-499c-aa5e-15a82e382521]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[743d2c80-4514-48b0-8c39-87c6cc1c4f05]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Flushing IO for device /dev/sdj {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e8738-20b5-42fd-b601-8ae30263cdf2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966d9ca-3ff0-4892-b80e-0a292d07558a]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] SCSI volumes sdj have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635ecab-4814-4c17-9773-c2906a9c99ee]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb06621-3bb0-47b5-a5d5-4a3f9e837340]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]
Jul 27 16:37:20 user nova-compute[71026]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd91e1-2dbe-4f20-86c4-b199011599e8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== disconnect_volume: return (389ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd', 'serial'} {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 16:37:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: removing Cinder connection for volume 60c071d3-854e-4682-aad6-4f9e2d33f389 {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 16:37:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: Updating volume 60c071d3-854e-4682-aad6-4f9e2d33f389 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TOoALsJw", "auth_password": "buI0B81yAJKdYf", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "01f786b8-2812-4967-a63d-a969672debbd"}, "status": "reserved", "instance": "4256bebd-a216-46e4-acd9-fa7fe38422cd", "attached_at": "", "detached_at": "", "volume_id": "01f786b8-2812-4967-a63d-a969672debbd", "serial": "01f786b8-2812-4967-a63d-a969672debbd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd', 'no_device': None, 'attachment_id': '58312c73-6dad-44ca-83b7-197b8384b579'} {{(pid=71026) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 16:37:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71edd974-4b4f-4ea7-b251-ee178740b2e6 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.045s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:21 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475826.3846807, 3d7e58a9-6acf-4584-bb38-1d88d536ed63 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:37:21 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] VM Stopped (Lifecycle Event)
Jul 27 16:37:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-23c5d45e-2d31-4c91-b16b-0ae032a370ab None None] [instance: 3d7e58a9-6acf-4584-bb38-1d88d536ed63] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14518276-94d0-47b8-b98a-bc9966495795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f359d429-c7f8-4c96-9744-a3f60a482cd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954250a-e4e7-4c41-9e08-acbb9dc00ab7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ae1d8-fb1c-4848-b9f5-d2349386b22a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:37:22 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:37:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a453f-3bdb-4edc-9186-e0666fa89007]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:37:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:22 user nova-compute[71026]: INFO nova.compute.manager [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Swapping volume 01f786b8-2812-4967-a63d-a969672debbd for 60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-changed-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing instance network info cache due to event network-changed-968f7270-4d51-4efe-9620-941bea39a65b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:37:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] Acquiring lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:37:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] Acquired lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:37:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Refreshing network info cache for port 968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '60c071d3-854e-4682-aad6-4f9e2d33f389', 'serial': '60c071d3-854e-4682-aad6-4f9e2d33f389'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd'}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd', 'serial'} {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:30 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:30 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:30 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb9c7c-8dd9-4068-b087-9643d93c03c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:37:30 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updated VIF entry in instance network info cache for port 968f7270-4d51-4efe-9620-941bea39a65b. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[095641f8-775d-425d-a419-27ef925ea947]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389] added
Jul 27 16:37:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c6dcfe8-df30-44a6-8428-6396e348ed5d req-4a5f23af-0f87-4d1d-a03f-13f7ad69f50e service nova] Releasing lock "refresh_cache-d79cf19e-8872-4bf6-ac21-3832ce196f1b" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327a1f5-8e1d-40eb-8cdf-f0803de47797]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd170d7-2d31-4687-a819-a455125b00c6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgnJIlRi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zgnJIlRi" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5155ad-f096-4f0d-8dd6-c31f02f25e6f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zgnJIlRi'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7852c0-0f7d-4cc3-a9c2-f875517e1c33]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441369d-2cb6-4728-88a3-eecf4e7513f2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --login" returned: 0 in 0.162s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363790e-d08d-47ee-9626-97efa4cee13b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]
Jul 27 16:37:31 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8442f9e4-b0e5-48a7-9a38-0ee34bc6bd49]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b733ac1-3df6-459c-a372-e1e762a1a342]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa488f-c9d0-497f-bc55-af079f7a616b]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:37:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.547s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== connect_volume: return (1549ms) {'type': 'block', 'scsi_wwn': '26231306137306430', 'path': '/dev/sdi'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231306137306430', 'path': '/dev/sdi'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG nova.objects.instance [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lazy-loading 'flavor' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:32 user nova-compute[71026]: INFO nova.compute.manager [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Terminating instance
Jul 27 16:37:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 160432128 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-b35e1f14-2bec-4df2-90cb-e0ad12284492 req-1d3692b5-45e6-4c07-8810-ba26a7105687 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-6f400432-0713-4f30-b800-6b91a6631ff4 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-13345c01-1145-4e7c-ae5a-ecac6a7572b6 req-ae4b061c-3d40-46e6-970f-0b87e49838bf service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-968f7270-4d51-4efe-9620-941bea39a65b for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 304087040 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Instance destroyed successfully.
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lazy-loading 'resources' on Instance uuid d79cf19e-8872-4bf6-ac21-3832ce196f1b {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap968f7270-4d, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:1a:7b,bridge_name='br-int',has_traffic_filtering=True,id=968f7270-4d51-4efe-9620-941bea39a65b,network=Network(c624a3e1-2b0a-4266-b8a7-57cc3cccd8df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap968f7270-4d')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728203cb-6d, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:29:b4,bridge_name='br-int',has_traffic_filtering=True,id=728203cb-6d0c-431c-90c4-4004fd686681,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap728203cb-6d')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f400432-07, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ce:61,bridge_name='br-int',has_traffic_filtering=True,id=6f400432-0713-4f30-b800-6b91a6631ff4,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f400432-07')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ad549db-6f, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 576716800 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:50,bridge_name='br-int',has_traffic_filtering=True,id=7ad549db-6ffd-4627-8490-9fe04a140c98,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ad549db-6f')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b5a2416-d6, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:d9:d9,bridge_name='br-int',has_traffic_filtering=True,id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2,network=Network(d20afd25-9535-4b7c-88b8-413933a81fc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b5a2416-d6')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "address": "fa:16:3e:05:1c:7c", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf85a48f1-7d", "ovs_interfaceid": "f85a48f1-7d0f-478f-a2d5-bdf6597980cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf85a48f1-7d, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1c:7c,bridge_name='br-int',has_traffic_filtering=True,id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf85a48f1-7d')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2066672567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2066672567',id=10,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8gvHK2T4B2goqb2gL+CCk6gL6448DHv8o7HXA7w1XPnG2qSE1a2svSOGXsrgD1tMFwEYRPYC5foHTCTysBx39Q7/OS18hv6Zt6HsW9uwr65vqTrbArXimVZZOjBA4SWg==',key_name='tempest-keypair-1898001353',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a5d193270fe43fcb9516b643067600e',ramdisk_id='',reservation_id='r-3d4f9enw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-744779166',owner_user_name='tempest-TaggedBootDevicesTest-744779166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bf92dd356ac4b9cab696fda110c0fd4',uuid=d79cf19e-8872-4bf6-ac21-3832ce196f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converting VIF {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6919b96c-f2, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:34 user nova-compute[71026]: INFO os_vif [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ca:c2,bridge_name='br-int',has_traffic_filtering=True,id=6919b96c-f209-4c0f-b6fb-130ec7025c06,network=Network(8b84a475-6abd-42ab-a143-f3a5d93e5a1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6919b96c-f2')
Jul 27 16:37:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BJMKdrgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa1f92-2d62-4bb2-a318-58f5ad8f3743]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: iSNS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: STATIC:
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:35 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b80c44-58e1-4029-b4eb-49b6fbdd2eaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b90fc-5935-4a32-9453-eb167f46b11f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a8228820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11249f81-dae1-47b0-b0a9-9a1e0c567d00]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179d908-7b80-4b89-80f7-767f11d83105]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d03380-9b22-4deb-a1de-8cfa0c4f2931]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97ca4f-fd2c-4ffe-b615-d934fd7c172f]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3e09a-3637-4238-9731-3a248e56f973]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8f308-cfd6-4e14-8a97-a4a30388c6bd]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260]
Jul 27 16:37:35 user nova-compute[71026]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18d2c607-7d5f-4615-befb-60bcfdc6f654 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[103338f3-255d-4b9a-bcb6-4dfc31fd90f1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== disconnect_volume: return (458ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGBOChSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbf079-83da-485a-b992-cb551009c0e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: iSNS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: STATIC:
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:35 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72aa6a4-29b2-4e2d-accd-31d56766a4d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd713e9-f782-42a6-bcb2-0da8805e6942]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a822b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc5e6a-6cdf-4770-926b-11dcdc37d107]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-968f7270-4d51-4efe-9620-941bea39a65b for instance with vm_state active and task_state deleting.
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-728203cb-6d0c-431c-90c4-4004fd686681 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-728203cb-6d0c-431c-90c4-4004fd686681 for instance with vm_state active and task_state deleting.
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-15ad60e5-1da6-41c8-ba87-96bb8528b010 req-d92ac683-81a7-464c-9eed-24022472014b service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-7ad549db-6ffd-4627-8490-9fe04a140c98 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6f400432-0713-4f30-b800-6b91a6631ff4 for instance with vm_state active and task_state deleting.
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING nova.compute.manager [req-bb702911-1adf-4a59-9e69-4eac1ed4d378 req-04ac8cfe-19c0-4e52-a7ec-e157c66b8aea service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 for instance with vm_state active and task_state deleting.
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4feea-5eb3-4cb9-82b4-e3aac340ff36]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4c004-c55f-41e6-b332-f3eecda4887d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b13a43-4ea3-4db9-a6a5-08f764d0c0e8]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5919872b-52ea-4f78-8a29-2756986864f0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79123ca-77f2-4554-9c82-e2175c760d94]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260]
Jul 27 16:37:35 user nova-compute[71026]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 837812224 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8677d731-33d9-46f5-a148-a2335903673c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2c7ed-03e1-4246-a171-46f3640cbf09]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== disconnect_volume: return (417ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oRJhcvlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:35 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bad3b4-2585-4659-a1ba-a530cebbfdc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: iSNS:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]: STATIC:
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:35 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:35 user nova-compute[71026]: No targets found.
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:35 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:35 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73213c8-f6cc-46cc-92ca-3086e8f3de5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5b05d-90cc-4090-a8d1-49d17c2ad10e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80d4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dff23d-4039-4f45-b093-0a6cb726f46e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64629a8-2d9c-41e3-a804-7ef8e206e507]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cc16c4-5851-4c83-a1a9-5dea9dcfa2fc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985ad8b-805a-4d5e-83d4-bd2f795df78b]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b86aa0f-4637-452b-b7a5-8545ce324d65]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf50fb8-6f39-42db-b840-478b9c03013a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260]
Jul 27 16:37:36 user nova-compute[71026]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5b0f0ad-6168-465d-8d08-f613fefbd5d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd22faf4-b56b-4bfe-8b86-5731fb0c5147]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] <== disconnect_volume: return (458ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Deleting instance files /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b_del
Jul 27 16:37:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Deletion of /opt/stack/data/nova/instances/d79cf19e-8872-4bf6-ac21-3832ce196f1b_del complete
Jul 27 16:37:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 969932800 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:36 user nova-compute[71026]: INFO nova.compute.manager [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Took 3.86 seconds to destroy the instance on the hypervisor.
Jul 27 16:37:36 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TOoALsJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '01f786b8-2812-4967-a63d-a969672debbd'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:37 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d40688-c8dd-4b16-afee-ff09bc18fb09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:37 user nova-compute[71026]: No targets found.
Jul 27 16:37:37 user nova-compute[71026]: iSNS:
Jul 27 16:37:37 user nova-compute[71026]: No targets found.
Jul 27 16:37:37 user nova-compute[71026]: STATIC:
Jul 27 16:37:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd
Jul 27 16:37:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:37 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:37 user nova-compute[71026]: No targets found.
Jul 27 16:37:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:37 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:37 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e2e6f-54f8-4c46-a05f-a93bc3b5e12d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444e02a-b926-4101-a848-c8df47fda227]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30ac139630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd'): ({'sdh'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Removing single pathed devices sdh {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d778feea-83fb-4bda-96b3-d62f4b487b25]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:37 user nova-compute[71026]: WARNING nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-7ad549db-6ffd-4627-8490-9fe04a140c98 for instance with vm_state active and task_state deleting.
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:37 user nova-compute[71026]: WARNING nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-f85a48f1-7d0f-478f-a2d5-bdf6597980cf for instance with vm_state active and task_state deleting.
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-unplugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-26aae4c6-5d76-404d-89da-b9fbdaa5ee16 req-bbc1ccbd-bc1a-4edb-a093-65e70709d846 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-unplugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6352c36d-c3f4-4fa0-9b93-e48c367679c6]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Flushing IO for device /dev/sdh {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-changed-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing instance network info cache due to event network-changed-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] Acquiring lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] Acquired lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.network.neutron [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Refreshing network info cache for port db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[681eabf4-7757-4e42-b99d-7be2222ad2b3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424f35a-5d3f-4113-83e2-646a53eb7557]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] SCSI volumes sdh have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad68f5-bbc7-4632-b7ad-b7e1cd6de6b3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469bbe1-cc1b-42de-a22f-a5d14aed6a6a]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260]
Jul 27 16:37:37 user nova-compute[71026]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01f786b8-2812-4967-a63d-a969672debbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76930e2-c4c4-402f-ae4a-2bf98c36ae6b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] <== disconnect_volume: return (432ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '4256bebd-a216-46e4-acd9-fa7fe38422cd', 'attached_at': '', 'detached_at': '', 'volume_id': '60c071d3-854e-4682-aad6-4f9e2d33f389', 'serial'} {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: removing Cinder connection for volume 01f786b8-2812-4967-a63d-a969672debbd {{(pid=71026) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updated VIF entry in instance network info cache for port db31dc20-d0e7-4e5d-a4ea-c0fe71096d54. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3e84a6-b687-43a8-8f4e-ba7b93263733 req-4eca7919-55c2-451f-8a13-01ca2ba67e1d service nova] Releasing lock "refresh_cache-259fd1d1-10f6-443e-ac1a-2824ee3c04fc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:37:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] swap_volume: Updating volume 01f786b8-2812-4967-a63d-a969672debbd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zgnJIlRi", "auth_password": "8Vx6CJUcHMPyNY", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "60c071d3-854e-4682-aad6-4f9e2d33f389"}, "status": "reserved", "instance": "4256bebd-a216-46e4-acd9-fa7fe38422cd", "attached_at": "", "detached_at": "", "volume_id": "60c071d3-854e-4682-aad6-4f9e2d33f389", "serial": "60c071d3-854e-4682-aad6-4f9e2d33f389"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '60c071d3-854e-4682-aad6-4f9e2d33f389', 'no_device': None, 'attachment_id': '843b8c28-87f0-4a58-98c0-b11c088d3f05'} {{(pid=71026) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-be6e357f-4b9d-4985-8eea-3f7c328028e2 tempest-TestVolumeSwap-496993424 tempest-TestVolumeSwap-496993424-project-admin] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.717s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:39 user nova-compute[71026]: INFO nova.compute.manager [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Terminating instance
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-846af038-0d16-4973-8ca5-3e836bcb965a req-dcfc703c-3a9c-4f68-9857-7d05830e81db service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-deleted-f85a48f1-7d0f-478f-a2d5-bdf6597980cf {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:39 user nova-compute[71026]: INFO nova.compute.manager [req-846af038-0d16-4973-8ca5-3e836bcb965a req-dcfc703c-3a9c-4f68-9857-7d05830e81db service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Neutron deleted interface f85a48f1-7d0f-478f-a2d5-bdf6597980cf; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.network.neutron [req-846af038-0d16-4973-8ca5-3e836bcb965a req-dcfc703c-3a9c-4f68-9857-7d05830e81db service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "address": "fa:16:3e:41:d9:d9", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b5a2416-d6", "ovs_interfaceid": "7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-846af038-0d16-4973-8ca5-3e836bcb965a req-dcfc703c-3a9c-4f68-9857-7d05830e81db service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Detach interface failed, port_id=f85a48f1-7d0f-478f-a2d5-bdf6597980cf, reason: Instance d79cf19e-8872-4bf6-ac21-3832ce196f1b could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] Acquiring lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] No waiting events found dispatching network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:39 user nova-compute[71026]: WARNING nova.compute.manager [req-f547d1f4-3bfd-40b9-85f7-b264c9e7427f req-3a61e60e-3f2a-4e4e-8b1a-82def4f74ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received unexpected event network-vif-plugged-6919b96c-f209-4c0f-b6fb-130ec7025c06 for instance with vm_state active and task_state deleting.
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-75bfd41d-8d36-42c5-8f18-038a5ae79632 req-3c5358f4-f3d9-4503-8145-0e895842267e service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:40 user nova-compute[71026]: INFO nova.compute.manager [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Detaching volume 60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:40 user nova-compute[71026]: INFO nova.virt.block_device [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Attempting to driver detach volume 60c071d3-854e-4682-aad6-4f9e2d33f389 from mountpoint /dev/vdb
Jul 27 16:37:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Attempting to detach device vdb from instance 4256bebd-a216-46e4-acd9-fa7fe38422cd from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:40 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:40 user nova-compute[71026]:   <source dev="/dev/sdi"/>
Jul 27 16:37:40 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:40 user nova-compute[71026]:   <serial>60c071d3-854e-4682-aad6-4f9e2d33f389</serial>
Jul 27 16:37:40 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:37:40 user nova-compute[71026]: </disk>
Jul 27 16:37:40 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Successfully detached device vdb from instance 4256bebd-a216-46e4-acd9-fa7fe38422cd from the persistent domain config.
Jul 27 16:37:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4256bebd-a216-46e4-acd9-fa7fe38422cd from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:37:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:37:40 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:37:40 user nova-compute[71026]:   <source dev="/dev/sdi"/>
Jul 27 16:37:40 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:37:40 user nova-compute[71026]:   <serial>60c071d3-854e-4682-aad6-4f9e2d33f389</serial>
Jul 27 16:37:40 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:37:40 user nova-compute[71026]: </disk>
Jul 27 16:37:40 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690475861.2088592, 4256bebd-a216-46e4-acd9-fa7fe38422cd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:37:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Successfully detached device vdb from instance 4256bebd-a216-46e4-acd9-fa7fe38422cd from the live domain config.
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zgnJIlRi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '60c071d3-854e-4682-aad6-4f9e2d33f389'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:41 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Instance destroyed successfully.
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.objects.instance [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lazy-loading 'resources' on Instance uuid 259fd1d1-10f6-443e-ac1a-2824ee3c04fc {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c63b0-1ca4-4d86-b24e-b4c5cf94609d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]: iSNS:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]: STATIC:
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:41 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:41 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb31dc20-d0, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c222ea-0392-48b1-9ecb-b84b9f15eee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[118814de-abdf-4cf2-85b1-c2f0f961621c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30887a0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389'): ({'sdi'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Removing single pathed devices sdi {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:46:56,bridge_name='br-int',has_traffic_filtering=True,id=db31dc20-d0e7-4e5d-a4ea-c0fe71096d54,network=Network(3d6871fa-a8a3-4639-bb21-f3efb3b29c62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb31dc20-d0')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8db6e99-ef, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f545f-ca65-4156-b8af-c1d73c250564]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a0126-3f48-49d1-bb36-e9e57a0b1757]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Flushing IO for device /dev/sdi {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[faffc458-adc7-46c7-a2e1-7b3fdf78c577]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:07:32,bridge_name='br-int',has_traffic_filtering=True,id=d8db6e99-efb8-4e4c-b705-9d7b167b1f79,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8db6e99-ef')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9caf0fb5-11, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-deleted-7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: INFO nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Neutron deleted interface 7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.neutron [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "address": "fa:16:3e:0a:ca:c2", "network": {"id": "8b84a475-6abd-42ab-a143-f3a5d93e5a1f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1915546557", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6919b96c-f2", "ovs_interfaceid": "6919b96c-f209-4c0f-b6fb-130ec7025c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.067s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[699dcda4-1e18-4583-bbc1-5fbac4a90966]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] SCSI volumes sdi have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fcb2b-988f-4ade-80cb-6a0a43aefd11]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:85:3c,bridge_name='br-int',has_traffic_filtering=True,id=9caf0fb5-11ae-47c0-94ee-954e326b4a40,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9caf0fb5-11')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "address": "fa:16:3e:41:67:a6", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc539af1-fb", "ovs_interfaceid": "cc539af1-fb26-48dc-a76e-fa75b0fce4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc539af1-fb, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Detach interface failed, port_id=7b5a2416-d699-49dc-82c7-8e2c1cfe8ac2, reason: Instance d79cf19e-8872-4bf6-ac21-3832ce196f1b could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-deleted-6919b96c-f209-4c0f-b6fb-130ec7025c06 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: INFO nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Neutron deleted interface 6919b96c-f209-4c0f-b6fb-130ec7025c06; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.neutron [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [{"id": "968f7270-4d51-4efe-9620-941bea39a65b", "address": "fa:16:3e:8c:1a:7b", "network": {"id": "c624a3e1-2b0a-4266-b8a7-57cc3cccd8df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-540322305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap968f7270-4d", "ovs_interfaceid": "968f7270-4d51-4efe-9620-941bea39a65b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "728203cb-6d0c-431c-90c4-4004fd686681", "address": "fa:16:3e:5b:29:b4", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728203cb-6d", "ovs_interfaceid": "728203cb-6d0c-431c-90c4-4004fd686681", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f400432-0713-4f30-b800-6b91a6631ff4", "address": "fa:16:3e:f9:ce:61", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f400432-07", "ovs_interfaceid": "6f400432-0713-4f30-b800-6b91a6631ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ad549db-6ffd-4627-8490-9fe04a140c98", "address": "fa:16:3e:0d:77:50", "network": {"id": "d20afd25-9535-4b7c-88b8-413933a81fc7", "bridge": "br-int", "label": "tempest-device-tagging-net1-1878782968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a5d193270fe43fcb9516b643067600e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ad549db-6f", "ovs_interfaceid": "7ad549db-6ffd-4627-8490-9fe04a140c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fc7a64-cfd5-490b-9a10-075a275beba6]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260]
Jul 27 16:37:41 user nova-compute[71026]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:67:a6,bridge_name='br-int',has_traffic_filtering=True,id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc539af1-fb')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ae2987d-30, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Detach interface failed, port_id=6919b96c-f209-4c0f-b6fb-130ec7025c06, reason: Instance d79cf19e-8872-4bf6-ac21-3832ce196f1b could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:41 user nova-compute[71026]: WARNING nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-9caf0fb5-11ae-47c0-94ee-954e326b4a40 for instance with vm_state active and task_state deleting.
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-49ec9cfe-909d-4022-94ea-c97c0152d3ad req-e671b8ca-255b-415e-85f2-dd6362275ff4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c071d3-854e-4682-aad6-4f9e2d33f389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52122549-3890-46ab-8833-22dfe4c6d197]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] <== disconnect_volume: return (448ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:1f,bridge_name='br-int',has_traffic_filtering=True,id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4,network=Network(53dc5c8c-029d-4c5a-8395-0822ce367f37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ae2987d-30')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap390a7b2e-5b, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:eb:67,bridge_name='br-int',has_traffic_filtering=True,id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap390a7b2e-5b')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1263370229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1263370229',id=11,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj37C37nESguhsdzvXG7aaLAznCwU/JUdrm162diKvJysmUuZg3QsFpwHHXhnBA4Ec9SVpY9FIjphogJK4iyqVXXuGtkMw030ThipM4e5Kc2hdvxMf/bemiZIzBaqr3Xg==',key_name='tempest-keypair-2124513718',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fbff68dc0f147b6860273328c46fdb6',ramdisk_id='',reservation_id='r-g95knqol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-59168722',owner_user_name='tempest-TaggedBootDevicesTest_v242-59168722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ea19ebae24043b7a4504c09536f560e',uuid=259fd1d1-10f6-443e-ac1a-2824ee3c04fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converting VIF {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b2386fd-4a, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:41 user nova-compute[71026]: INFO os_vif [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:7a:d1,bridge_name='br-int',has_traffic_filtering=True,id=0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4,network=Network(5ce23141-10fd-496e-ac32-8f9635b89779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b2386fd-4a')
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KOnjNpWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:41 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cccbe5-2695-4e36-8fec-451ccf7db070]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]: iSNS:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]: STATIC:
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:41 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:41 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:41 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:41 user nova-compute[71026]: No targets found.
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:41 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:41 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a576e7a-5259-4728-9a28-3519f7d66de7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f319e-cc5b-43aa-a035-6d067a4e253f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 (non-flash)
Jul 27 16:37:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a822ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069'): ({'sdg'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Removing single pathed devices sdg {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:41 user nova-compute[71026]: WARNING nova.compute.manager [req-eaec8db9-7f21-49e5-80cb-3b9a5203a18b req-e69708b1-b7d0-44c7-938d-6a4acea7add4 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-d8db6e99-efb8-4e4c-b705-9d7b167b1f79 for instance with vm_state active and task_state deleting.
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1e3d76-d53a-4580-88d7-a1f1a4011d71]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6808e8-5375-4e8b-9cb3-f6c344081dbb]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Flushing IO for device /dev/sdg {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c45f4d-03b3-438a-ab25-bfe3aed4bab0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfda2dd9-e3c7-4a40-b9f3-cb550fd6eb32]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] SCSI volumes sdg have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7eeb69-c715-40aa-aa41-065cfed4a638]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa33ec2-e301-42c6-9bbb-15f358ec3a4b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260]
Jul 27 16:37:42 user nova-compute[71026]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10847339-5a9e-4546-9fa6-9982db36d069 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c23c849-a3d9-4c13-8507-14d17a5effd0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== disconnect_volume: return (376ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISqHlUse', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:42 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:42 user nova-compute[71026]: WARNING nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 for instance with vm_state active and task_state deleting.
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:42 user nova-compute[71026]: WARNING nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 for instance with vm_state active and task_state deleting.
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-fd3ede84-2c6b-4457-aeae-6534a08a6bf4 req-476e0e0d-fe19-4f35-afdd-09799afae6a1 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4c4f8-ce4a-40d9-b510-8b40824d62ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]: iSNS:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]: STATIC:
Jul 27 16:37:42 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:42 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:42 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:42 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3
Jul 27 16:37:42 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:42 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:42 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:42 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:42 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4a85c-5ad1-4b60-81f2-504c812bcc2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53367887-7707-4515-8c3f-165c8fa87fb1]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088541630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3'): ({'sdf'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Removing single pathed devices sdf {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c522f3-1071-4556-8c44-d8f883afad9c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[150da378-ce2c-45b7-bcb6-fdac098aa15b]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Flushing IO for device /dev/sdf {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89163dc3-698a-4c9e-a4b9-aea35e696583]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a67e07-039f-406a-885a-25707f42d315]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f396174-ddbc-4e42-b676-a7de55f798a8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a07958-e9a5-48fc-99b0-61140a22d305]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260]
Jul 27 16:37:42 user nova-compute[71026]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88cc22ca-1bac-4699-8c30-e36ad1e22ab3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5393e1ac-f5cf-4db8-81e9-0ff7226fca97]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== disconnect_volume: return (332ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OiWoyswV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:37:42 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6811c6-a422-4d7f-8251-8d2dfdea32e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]: iSNS:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]: STATIC:
Jul 27 16:37:42 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055
Jul 27 16:37:42 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:37:42 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:37:42 user nova-compute[71026]: FIRMWARE:
Jul 27 16:37:42 user nova-compute[71026]: No targets found.
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:37:42 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:37:42 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02160c67-db67-4e76-98ba-a410dcf541f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1caa31-1dac-43df-913c-fd7784da61b5]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 (non-flash)
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a82280d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055'): ({'sde'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Removing single pathed devices sde {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f786baa-887f-466c-9af2-9cfdc02c3764]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5960b2-18d9-4a34-9b06-44de2a844660]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Flushing IO for device /dev/sde {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0831d8b-04da-4156-9ba1-ec8e5c6cb4eb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ff487-702c-468a-bce8-a18b19507748]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf2ddc-1662-4ebd-aef5-b8163bbfff4d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.objects.instance [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'flavor' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6fbb89-72a6-451a-ac8e-9846275a0a19]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260]
Jul 27 16:37:42 user nova-compute[71026]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055, portal: 172.16.0.220,3260] successful.
Jul 27 16:37:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c43a9fbf-4dd4-4e15-9486-03693f4e2055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a0e8b4-560b-4825-9e8d-4bf2b259fc30]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] <== disconnect_volume: return (302ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:37:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Deleting instance files /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc_del
Jul 27 16:37:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Deletion of /opt/stack/data/nova/instances/259fd1d1-10f6-443e-ac1a-2824ee3c04fc_del complete
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-94dd99d7-2ddf-4e39-ad8c-0aadc28e8d9d tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.316s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:42 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Took 6.40 seconds to deallocate network for instance.
Jul 27 16:37:42 user nova-compute[71026]: INFO nova.compute.manager [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Took 3.74 seconds to destroy the instance on the hypervisor.
Jul 27 16:37:42 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:37:42 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:43 user nova-compute[71026]: WARNING nova.compute.manager [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 for instance with vm_state active and task_state deleting.
Jul 27 16:37:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-deleted-968f7270-4d51-4efe-9620-941bea39a65b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-956f1b33-88af-402c-899f-7c4738df2b45 req-d1126641-c978-4af8-9506-0b416199f5ee service nova] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Received event network-vif-deleted-7ad549db-6ffd-4627-8490-9fe04a140c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:44 user nova-compute[71026]: WARNING nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 for instance with vm_state active and task_state deleting.
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-unplugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-unplugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Acquiring lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] No waiting events found dispatching network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:44 user nova-compute[71026]: WARNING nova.compute.manager [req-88b52b5b-96c7-4e39-b908-50bf1ba2fb51 req-be36562c-f306-44ac-95b6-33f46a2c86ee service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received unexpected event network-vif-plugged-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 for instance with vm_state active and task_state deleting.
Jul 27 16:37:45 user nova-compute[71026]: INFO nova.compute.manager [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Took 2.37 seconds to detach 3 volumes for instance.
Jul 27 16:37:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-deleted-cc539af1-fb26-48dc-a76e-fa75b0fce4d8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:45 user nova-compute[71026]: INFO nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Neutron deleted interface cc539af1-fb26-48dc-a76e-fa75b0fce4d8; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "address": "fa:16:3e:d1:c8:1f", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ae2987d-30", "ovs_interfaceid": "4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Detach interface failed, port_id=cc539af1-fb26-48dc-a76e-fa75b0fce4d8, reason: Instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-deleted-4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:45 user nova-compute[71026]: INFO nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Neutron deleted interface 4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "address": "fa:16:3e:3f:eb:67", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap390a7b2e-5b", "ovs_interfaceid": "390a7b2e-5b2c-4ea5-b9fb-e8830541a110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:45 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Deleted allocations for instance d79cf19e-8872-4bf6-ac21-3832ce196f1b
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Detach interface failed, port_id=4ae2987d-30dd-4382-9a5d-bffe5e4ef6a4, reason: Instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-deleted-390a7b2e-5b2c-4ea5-b9fb-e8830541a110 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:45 user nova-compute[71026]: INFO nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Neutron deleted interface 390a7b2e-5b2c-4ea5-b9fb-e8830541a110; detaching it from the instance and deleting it from the info cache
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [{"id": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "address": "fa:16:3e:f8:46:56", "network": {"id": "3d6871fa-a8a3-4639-bb21-f3efb3b29c62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-543335431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb31dc20-d0", "ovs_interfaceid": "db31dc20-d0e7-4e5d-a4ea-c0fe71096d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "address": "fa:16:3e:d2:07:32", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8db6e99-ef", "ovs_interfaceid": "d8db6e99-efb8-4e4c-b705-9d7b167b1f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "address": "fa:16:3e:4e:85:3c", "network": {"id": "53dc5c8c-029d-4c5a-8395-0822ce367f37", "bridge": "br-int", "label": "tempest-device-tagging-net1-636254792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.132", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9caf0fb5-11", "ovs_interfaceid": "9caf0fb5-11ae-47c0-94ee-954e326b4a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "address": "fa:16:3e:d0:7a:d1", "network": {"id": "5ce23141-10fd-496e-ac32-8f9635b89779", "bridge": "br-int", "label": "tempest-device-tagging-net2-756685132", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4fbff68dc0f147b6860273328c46fdb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b2386fd-4a", "ovs_interfaceid": "0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-a138c6c1-b425-4c78-9ccb-afc245cf8953 req-d81e1834-119c-4ae0-9746-0e34eff14410 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Detach interface failed, port_id=390a7b2e-5b2c-4ea5-b9fb-e8830541a110, reason: Instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:37:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c21abcc-714d-4e94-8705-2ceb6666c643 tempest-TaggedBootDevicesTest-744779166 tempest-TaggedBootDevicesTest-744779166-project-member] Lock "d79cf19e-8872-4bf6-ac21-3832ce196f1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.382s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:47 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:47 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Took 4.21 seconds to deallocate network for instance.
Jul 27 16:37:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-25adfe9d-07a5-42aa-8ec8-d316385c1d1e req-e37852ff-23a7-4edd-b151-f7cd6e86f480 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-deleted-db31dc20-d0e7-4e5d-a4ea-c0fe71096d54 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-25adfe9d-07a5-42aa-8ec8-d316385c1d1e req-e37852ff-23a7-4edd-b151-f7cd6e86f480 service nova] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Received event network-vif-deleted-0b2386fd-4a77-4e7a-a4bf-0e09cd58dcd4 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:49 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475854.4405134, d79cf19e-8872-4bf6-ac21-3832ce196f1b => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:37:49 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] VM Stopped (Lifecycle Event)
Jul 27 16:37:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1fb4cea8-b251-4fae-827e-9b1c1c297563 None None] [instance: d79cf19e-8872-4bf6-ac21-3832ce196f1b] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:49 user nova-compute[71026]: INFO nova.compute.manager [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Took 2.53 seconds to detach 3 volumes for instance.
Jul 27 16:37:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:50 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:50 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:50 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Deleted allocations for instance 259fd1d1-10f6-443e-ac1a-2824ee3c04fc
Jul 27 16:37:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8cf0c194-8caf-4c10-9b90-01b672cbe653 tempest-TaggedBootDevicesTest_v242-59168722 tempest-TaggedBootDevicesTest_v242-59168722-project-member] Lock "259fd1d1-10f6-443e-ac1a-2824ee3c04fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.005s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:37:54 user nova-compute[71026]: INFO nova.compute.claims [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Claim successful on node user
Jul 27 16:37:54 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:37:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.policy [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789e9b39aef14ae4af5a48148b92994d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c84998d34fb49cb9cb17eb2b4353201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:37:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Creating image(s)
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "/opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "/opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk 1073741824" returned: 0 in 0.050s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Cannot resize image /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'migration_context' on Instance uuid 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Ensure instance console log exists: /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Successfully created port: 27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475861.2416303, 259fd1d1-10f6-443e-ac1a-2824ee3c04fc => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:37:56 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] VM Stopped (Lifecycle Event)
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fb757663-17bc-4be4-b261-9897c9fc307c None None] [instance: 259fd1d1-10f6-443e-ac1a-2824ee3c04fc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Successfully updated port: 27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquired lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-changed-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Refreshing instance network info cache due to event network-changed-27c322ab-47bd-4557-a5e0-b633a2581abd. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] Acquiring lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:37:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Updating instance_info_cache with network_info: [{"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Releasing lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Instance network_info: |[{"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] Acquired lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.neutron [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Refreshing network info cache for port 27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Start _get_guest_xml network_info=[{"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:37:57 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:37:57 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-396023020',display_name='tempest-VolumesAdminNegativeTest-server-396023020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-396023020',id=14,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-l9vcnmxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:37:55Z,user_data=None,user_id='789e9b39aef14ae4af5a48148b92994d',uuid=3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:37:57 user nova-compute[71026]:   <uuid>3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d</uuid>
Jul 27 16:37:57 user nova-compute[71026]:   <name>instance-0000000e</name>
Jul 27 16:37:57 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:37:57 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:37:57 user nova-compute[71026]:   <metadata>
Jul 27 16:37:57 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:37:57 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:name>tempest-VolumesAdminNegativeTest-server-396023020</nova:name>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:37:57</nova:creationTime>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:37:57 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:37:57 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:owner>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:user uuid="789e9b39aef14ae4af5a48148b92994d">tempest-VolumesAdminNegativeTest-1182056978-project-member</nova:user>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:project uuid="6c84998d34fb49cb9cb17eb2b4353201">tempest-VolumesAdminNegativeTest-1182056978</nova:project>
Jul 27 16:37:57 user nova-compute[71026]:       </nova:owner>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:37:57 user nova-compute[71026]:       <nova:ports>
Jul 27 16:37:57 user nova-compute[71026]:         <nova:port uuid="27c322ab-47bd-4557-a5e0-b633a2581abd">
Jul 27 16:37:57 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 16:37:57 user nova-compute[71026]:         </nova:port>
Jul 27 16:37:57 user nova-compute[71026]:       </nova:ports>
Jul 27 16:37:57 user nova-compute[71026]:     </nova:instance>
Jul 27 16:37:57 user nova-compute[71026]:   </metadata>
Jul 27 16:37:57 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:37:57 user nova-compute[71026]:     <system>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="serial">3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d</entry>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="uuid">3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d</entry>
Jul 27 16:37:57 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:37:57 user nova-compute[71026]:     </system>
Jul 27 16:37:57 user nova-compute[71026]:   </sysinfo>
Jul 27 16:37:57 user nova-compute[71026]:   <os>
Jul 27 16:37:57 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:37:57 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:37:57 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:37:57 user nova-compute[71026]:   </os>
Jul 27 16:37:57 user nova-compute[71026]:   <features>
Jul 27 16:37:57 user nova-compute[71026]:     <acpi/>
Jul 27 16:37:57 user nova-compute[71026]:     <apic/>
Jul 27 16:37:57 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:37:57 user nova-compute[71026]:   </features>
Jul 27 16:37:57 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:37:57 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:37:57 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:37:57 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:37:57 user nova-compute[71026]:   </clock>
Jul 27 16:37:57 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:37:57 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:37:57 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:37:57 user nova-compute[71026]:   </cpu>
Jul 27 16:37:57 user nova-compute[71026]:   <devices>
Jul 27 16:37:57 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:37:57 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:37:57 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk"/>
Jul 27 16:37:57 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:37:57 user nova-compute[71026]:     </disk>
Jul 27 16:37:57 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:37:57 user nova-compute[71026]:       <mac address="fa:16:3e:d2:70:0a"/>
Jul 27 16:37:57 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:37:57 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:37:57 user nova-compute[71026]:       <target dev="tap27c322ab-47"/>
Jul 27 16:37:57 user nova-compute[71026]:     </interface>
Jul 27 16:37:57 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:37:57 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/console.log" append="off"/>
Jul 27 16:37:57 user nova-compute[71026]:     </serial>
Jul 27 16:37:57 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:37:57 user nova-compute[71026]:     <video>
Jul 27 16:37:57 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:37:57 user nova-compute[71026]:     </video>
Jul 27 16:37:57 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:37:57 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:37:57 user nova-compute[71026]:     </rng>
Jul 27 16:37:57 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:37:57 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:37:57 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:37:57 user nova-compute[71026]:     </memballoon>
Jul 27 16:37:57 user nova-compute[71026]:   </devices>
Jul 27 16:37:57 user nova-compute[71026]: </domain>
Jul 27 16:37:57 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-396023020',display_name='tempest-VolumesAdminNegativeTest-server-396023020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-396023020',id=14,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-l9vcnmxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:37:55Z,user_data=None,user_id='789e9b39aef14ae4af5a48148b92994d',uuid=3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG os_vif [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27c322ab-47, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27c322ab-47, col_values=(('external_ids', {'iface-id': '27c322ab-47bd-4557-a5e0-b633a2581abd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:70:0a', 'vm-uuid': '3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:57 user nova-compute[71026]: INFO os_vif [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47')
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] No VIF found with MAC fa:16:3e:d2:70:0a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.neutron [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Updated VIF entry in instance network info cache for port 27c322ab-47bd-4557-a5e0-b633a2581abd. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG nova.network.neutron [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Updating instance_info_cache with network_info: [{"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:37:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3723b6a-fd8e-4eee-9590-9cca461a6558 req-49049436-160f-4d17-a7b9-28ec9eb5e09f service nova] Releasing lock "refresh_cache-3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:37:58 user nova-compute[71026]: INFO nova.compute.claims [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Claim successful on node user
Jul 27 16:37:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:37:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.policy [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79f44fae1caa4caa8a6d885d1d7ed62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed38129c3544646b88ae65cf73b552f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:37:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Creating image(s)
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk 1073741824" returned: 0 in 0.054s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] No waiting events found dispatching network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:37:59 user nova-compute[71026]: WARNING nova.compute.manager [req-d657c1dc-cca6-4114-8d45-476fe62db4d9 req-eedc2af1-54b4-4e06-b422-fa8483fe4c7b service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received unexpected event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd for instance with vm_state building and task_state spawning.
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Cannot resize image /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'migration_context' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Ensure instance console log exists: /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:37:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Successfully created port: 64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:38:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Successfully updated port: 64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:38:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:38:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Instance network_info: |[{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Start _get_guest_xml network_info=[{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:38:01 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:01 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'pci_devices' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:38:01 user nova-compute[71026]:   <uuid>ae684296-4f58-4329-a78d-0098769a937c</uuid>
Jul 27 16:38:01 user nova-compute[71026]:   <name>instance-0000000f</name>
Jul 27 16:38:01 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:38:01 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:38:01 user nova-compute[71026]:   <metadata>
Jul 27 16:38:01 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:38:01 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:name>tempest-device-tagging-server-1264265188</nova:name>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:38:01</nova:creationTime>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:38:01 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:38:01 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:owner>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:user uuid="79f44fae1caa4caa8a6d885d1d7ed62e">tempest-TaggedAttachmentsTest-10523810-project-member</nova:user>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:project uuid="fed38129c3544646b88ae65cf73b552f">tempest-TaggedAttachmentsTest-10523810</nova:project>
Jul 27 16:38:01 user nova-compute[71026]:       </nova:owner>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:38:01 user nova-compute[71026]:       <nova:ports>
Jul 27 16:38:01 user nova-compute[71026]:         <nova:port uuid="64270317-1447-4426-b429-cf1a1f41e6f1">
Jul 27 16:38:01 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:38:01 user nova-compute[71026]:         </nova:port>
Jul 27 16:38:01 user nova-compute[71026]:       </nova:ports>
Jul 27 16:38:01 user nova-compute[71026]:     </nova:instance>
Jul 27 16:38:01 user nova-compute[71026]:   </metadata>
Jul 27 16:38:01 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:38:01 user nova-compute[71026]:     <system>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="serial">ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="uuid">ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:38:01 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:38:01 user nova-compute[71026]:     </system>
Jul 27 16:38:01 user nova-compute[71026]:   </sysinfo>
Jul 27 16:38:01 user nova-compute[71026]:   <os>
Jul 27 16:38:01 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:38:01 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:38:01 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:38:01 user nova-compute[71026]:   </os>
Jul 27 16:38:01 user nova-compute[71026]:   <features>
Jul 27 16:38:01 user nova-compute[71026]:     <acpi/>
Jul 27 16:38:01 user nova-compute[71026]:     <apic/>
Jul 27 16:38:01 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:38:01 user nova-compute[71026]:   </features>
Jul 27 16:38:01 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:38:01 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:38:01 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:38:01 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:38:01 user nova-compute[71026]:   </clock>
Jul 27 16:38:01 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:38:01 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:38:01 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:38:01 user nova-compute[71026]:   </cpu>
Jul 27 16:38:01 user nova-compute[71026]:   <devices>
Jul 27 16:38:01 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:38:01 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:38:01 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk"/>
Jul 27 16:38:01 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:38:01 user nova-compute[71026]:     </disk>
Jul 27 16:38:01 user nova-compute[71026]:     <disk type="file" device="cdrom">
Jul 27 16:38:01 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none"/>
Jul 27 16:38:01 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config"/>
Jul 27 16:38:01 user nova-compute[71026]:       <target dev="hda" bus="ide"/>
Jul 27 16:38:01 user nova-compute[71026]:     </disk>
Jul 27 16:38:01 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:38:01 user nova-compute[71026]:       <mac address="fa:16:3e:41:55:6f"/>
Jul 27 16:38:01 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:01 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:38:01 user nova-compute[71026]:       <target dev="tap64270317-14"/>
Jul 27 16:38:01 user nova-compute[71026]:     </interface>
Jul 27 16:38:01 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:38:01 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log" append="off"/>
Jul 27 16:38:01 user nova-compute[71026]:     </serial>
Jul 27 16:38:01 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:38:01 user nova-compute[71026]:     <video>
Jul 27 16:38:01 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:01 user nova-compute[71026]:     </video>
Jul 27 16:38:01 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:38:01 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:38:01 user nova-compute[71026]:     </rng>
Jul 27 16:38:01 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:38:01 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:38:01 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:38:01 user nova-compute[71026]:     </memballoon>
Jul 27 16:38:01 user nova-compute[71026]:   </devices>
Jul 27 16:38:01 user nova-compute[71026]: </domain>
Jul 27 16:38:01 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG os_vif [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64270317-14, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64270317-14, col_values=(('external_ids', {'iface-id': '64270317-1447-4426-b429-cf1a1f41e6f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:55:6f', 'vm-uuid': 'ae684296-4f58-4329-a78d-0098769a937c'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:01 user nova-compute[71026]: INFO os_vif [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14')
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475881.3163753, 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] VM Resumed (Lifecycle Event)
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] No waiting events found dispatching network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:01 user nova-compute[71026]: WARNING nova.compute.manager [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received unexpected event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd for instance with vm_state building and task_state spawning.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-changed-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing instance network info cache due to event network-changed-64270317-1447-4426-b429-cf1a1f41e6f1. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing network info cache for port 64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Instance spawned successfully.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name hda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No VIF found with MAC fa:16:3e:41:55:6f, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Using config drive
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475881.316705, 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] VM Started (Lifecycle Event)
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Took 6.33 seconds to spawn the instance on the hypervisor.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Creating config drive at /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw58g0ghu {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw58g0ghu" returned: 0 in 0.066s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:01 user nova-compute[71026]: INFO nova.compute.manager [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Took 7.21 seconds to build instance.
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf384b2a-c470-4463-8c39-4343f5f3ac48 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.316s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updated VIF entry in instance network info cache for port 64270317-1447-4426-b429-cf1a1f41e6f1. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e7316314-9da2-4b19-8b30-c6da9f741e7e req-f940418c-9c7c-4310-922a-78015f1dcb2d service nova] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:03 user nova-compute[71026]: WARNING nova.compute.manager [req-78171d59-d2ae-4e56-91ba-91196973ca76 req-94deb865-ce3f-4403-ba11-3196f7a80d0c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 for instance with vm_state building and task_state spawning.
Jul 27 16:38:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:05 user nova-compute[71026]: WARNING nova.compute.manager [req-494f1078-4f2f-40ad-9da6-5b9128e35c30 req-fb3a6e9a-ffcf-46a0-b686-02b6c9c0874c service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 for instance with vm_state building and task_state spawning.
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475885.3224533, ae684296-4f58-4329-a78d-0098769a937c => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] VM Resumed (Lifecycle Event)
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] Instance spawned successfully.
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475885.3269017, ae684296-4f58-4329-a78d-0098769a937c => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] VM Started (Lifecycle Event)
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Took 6.66 seconds to spawn the instance on the hypervisor.
Jul 27 16:38:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:05 user nova-compute[71026]: INFO nova.compute.manager [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Took 7.44 seconds to build instance.
Jul 27 16:38:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0852292-525d-4a6d-a4c9-a24e94ab5e4f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.577s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:06 user nova-compute[71026]: INFO nova.compute.manager [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Terminating instance
Jul 27 16:38:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Instance destroyed successfully.
Jul 27 16:38:06 user nova-compute[71026]: DEBUG nova.objects.instance [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'resources' on Instance uuid f0e1f730-6df4-44b8-b794-44a80ccefd06 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1088306929',display_name='tempest-ServersNegativeTestJSON-server-1088306929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1088306929',id=12,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-55riutbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:32Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=f0e1f730-6df4-44b8-b794-44a80ccefd06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "address": "fa:16:3e:2b:2f:43", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d957d1-d7", "ovs_interfaceid": "96d957d1-d716-4bf2-8cc9-513ce4817d0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG os_vif [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d957d1-d7, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:38:06 user nova-compute[71026]: INFO os_vif [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2f:43,bridge_name='br-int',has_traffic_filtering=True,id=96d957d1-d716-4bf2-8cc9-513ce4817d0c,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d957d1-d7')
Jul 27 16:38:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Deleting instance files /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06_del
Jul 27 16:38:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Deletion of /opt/stack/data/nova/instances/f0e1f730-6df4-44b8-b794-44a80ccefd06_del complete
Jul 27 16:38:07 user nova-compute[71026]: INFO nova.compute.manager [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-unplugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] No waiting events found dispatching network-vif-unplugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-unplugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Acquiring lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] No waiting events found dispatching network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:07 user nova-compute[71026]: WARNING nova.compute.manager [req-9dd68b15-f263-4110-aee3-3269ec3a8e2e req-1f70038d-5e37-41d6-9241-f78b48f9ab65 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received unexpected event network-vif-plugged-96d957d1-d716-4bf2-8cc9-513ce4817d0c for instance with vm_state active and task_state deleting.
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-305d752a-e116-481c-a41a-9a87237c909b req-a8fd0f37-df36-4697-b0c8-180a25e1fd62 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Received event network-vif-deleted-96d957d1-d716-4bf2-8cc9-513ce4817d0c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:07 user nova-compute[71026]: INFO nova.compute.manager [req-305d752a-e116-481c-a41a-9a87237c909b req-a8fd0f37-df36-4697-b0c8-180a25e1fd62 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Neutron deleted interface 96d957d1-d716-4bf2-8cc9-513ce4817d0c; detaching it from the instance and deleting it from the info cache
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.network.neutron [req-305d752a-e116-481c-a41a-9a87237c909b req-a8fd0f37-df36-4697-b0c8-180a25e1fd62 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:07 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Took 0.66 seconds to deallocate network for instance.
Jul 27 16:38:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-305d752a-e116-481c-a41a-9a87237c909b req-a8fd0f37-df36-4697-b0c8-180a25e1fd62 service nova] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Detach interface failed, port_id=96d957d1-d716-4bf2-8cc9-513ce4817d0c, reason: Instance f0e1f730-6df4-44b8-b794-44a80ccefd06 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:08 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:38:08 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:38:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.621s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:08 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Deleted allocations for instance f0e1f730-6df4-44b8-b794-44a80ccefd06
Jul 27 16:38:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ef6b57b2-08a7-471e-9447-d508b0df6dd2 tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "f0e1f730-6df4-44b8-b794-44a80ccefd06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'flavor' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:11 user nova-compute[71026]: INFO nova.compute.manager [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attaching volume 3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 to /dev/vdb
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.utils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3c13a0-26c0-49c4-a6f7-e71682d1b8e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e08a44-9158-4f36-b00b-24f75f5bf383]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b976dffa-b9b5-4fe0-9413-233e4baca1cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb717bd-0d8f-4865-a55b-ef8954583317]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:11 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:38:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2343507-ee94-4fc0-9ad9-49ca96391d2e]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG os_brick.utils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating existing volume attachment record: 9626f288-86e6-4ff1-b4eb-ea34da456b64 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:38:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7409MB free_disk=25.791915893554688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4256bebd-a216-46e4-acd9-fa7fe38422cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance ae684296-4f58-4329-a78d-0098769a937c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:38:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'flavor' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:18 user nova-compute[71026]: INFO nova.compute.manager [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Attaching volume 9d46bf45-57e8-4cdb-bebe-11c2f0dec979 to /dev/vdb
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.utils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5f2560-394e-4924-9e0f-9c2c3be15abd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16240756-fed0-48b7-8738-582474e752e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[140b3c61-2c5d-4f75-97f8-0c62fb341544]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceba272-ee6c-407d-bea4-a7e54fb3ba32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:18 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ae7574-c816-494f-b293-31e926366454]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.utils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating existing volume attachment record: 3771fde1-fa1f-4357-9fa1-f94a76494608 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:18 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:18 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:18 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30cd8d4-58bb-4c07-9ceb-f1e3d0b2fec0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:38:18 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db44f4-6aed-434b-8303-f9b03825c6bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9] added
Jul 27 16:38:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2634dd7-f6f5-4ffd-b687-42f6236809f5]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be8f75c-eadc-4e6a-9619-cec543505fc0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYSOsuKg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYSOsuKg" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b207f91-5d8c-45ab-80be-4baf80bcd410]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYSOsuKg'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70c7968-8ac9-4be9-9a51-07c234b30f8c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ed7de-35ef-4dca-89f6-db67febedb55]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:38:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:38:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 16:38:19 user nova-compute[71026]: 
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[578ad4a9-89a5-4185-a7c9-3acc041ac953]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260]
Jul 27 16:38:19 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260] successful.
Jul 27 16:38:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751e718-a545-4896-aedc-f90fcd5b728e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fc566c-20e9-4c44-a71e-9e584be21df0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2818451-9043-40d0-b933-a9d65eb99d07]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:38:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updating instance_info_cache with network_info: [{"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-7057a6bb-81b2-42a9-910c-c264a450fa20" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26430626231313530', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430626231313530', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'flavor' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:38:20 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:38:20 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:38:20 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:38:20 user nova-compute[71026]:   <serial>3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9</serial>
Jul 27 16:38:20 user nova-compute[71026]: </disk>
Jul 27 16:38:20 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No VIF found with MAC fa:16:3e:15:10:68, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:38:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c33a24df-25ba-4a73-97b9-964670096c6d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.521s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:38:21 user nova-compute[71026]: INFO nova.compute.manager [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Rescuing
Jul 27 16:38:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475886.8546195, f0e1f730-6df4-44b8-b794-44a80ccefd06 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:21 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] VM Stopped (Lifecycle Event)
Jul 27 16:38:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-046ff227-bdbd-416b-b1f2-2d7b65b1978c None None] [instance: f0e1f730-6df4-44b8-b794-44a80ccefd06] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:22 user nova-compute[71026]: WARNING nova.compute.manager [req-b71a9e07-4d30-4c81-ad9e-aa0c56c75fbd req-956d2928-6979-41d3-9770-728628b9bdc1 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance destroyed successfully.
Jul 27 16:38:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attempting a stable device rescue
Jul 27 16:38:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:38:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Creating image(s)
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.images [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] 2938e508-da3b-47dd-9609-e8266f2a8b1e was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.part /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.part /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.converted" returned: 0 in 0.226s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.compute.manager [req-53356465-1507-47cd-9854-1ad905b12e13 req-dffcd37d-2298-4ea5-9845-705c2575aaa3 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d,backing_fmt=raw /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d,backing_fmt=raw /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue" returned: 0 in 0.064s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "7ae450de7d32bdc03f5dbc21e717a5cd31525c1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'migration_context' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start _get_guest_xml network_info=[{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "vif_mac": "fa:16:3e:15:10:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2938e508-da3b-47dd-9609-e8266f2a8b1e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9626f288-86e6-4ff1-b4eb-ea34da456b64', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1015a1e1-69ee-42a0-acf9-597323751110', 'attached_at': '', 'detached_at': '', 'volume_id': '3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'serial': '3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'resources' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'numa_topology' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:24 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:24 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:24 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255b26c-fc8f-499e-bd63-2b7ec0bedeae]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wYSOsuKg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 16:38:24 user nova-compute[71026]: node.name = iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:38:24 user nova-compute[71026]: node.tpgt = -1
Jul 27 16:38:24 user nova-compute[71026]: node.startup = automatic
Jul 27 16:38:24 user nova-compute[71026]: node.leading_login = No
Jul 27 16:38:24 user nova-compute[71026]: iface.iscsi_ifacename = default
Jul 27 16:38:24 user nova-compute[71026]: iface.net_ifacename = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.ipaddress = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.prefix_len = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.hwaddress = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.transport_name = tcp
Jul 27 16:38:24 user nova-compute[71026]: iface.initiatorname = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.vlan_id = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.vlan_priority = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.vlan_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.iface_num = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.mtu = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.port = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.bootproto = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.subnet_mask = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.gateway = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_alt_client_id = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_dns = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_learn_iqn = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_vendor_id_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_vendor_id = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.dhcp_slp_da = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.fragmentation = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.gratuitous_arp = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.incoming_forwarding = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.tos_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.tos = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.ttl = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.delayed_ack = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.tcp_nagle = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.tcp_wsf_state = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.tcp_wsf = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.tcp_timer_scale = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.tcp_timestamp = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.redirect = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.def_task_mgmt_timeout = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.header_digest = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.data_digest = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.immediate_data = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.initial_r2t = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.data_seq_inorder = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.data_pdu_inorder = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.erl = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.max_receive_data_len = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.first_burst_len = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.max_outstanding_r2t = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.max_burst_len = 0
Jul 27 16:38:24 user nova-compute[71026]: iface.chap_auth = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.bidi_chap = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.strict_login_compliance = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.discovery_auth = <empty>
Jul 27 16:38:24 user nova-compute[71026]: iface.discovery_logout = <empty>
Jul 27 16:38:24 user nova-compute[71026]: node.discovery_address = <empty>
Jul 27 16:38:24 user nova-compute[71026]: node.discovery_port = 0
Jul 27 16:38:24 user nova-compute[71026]: node.discovery_type = static
Jul 27 16:38:24 user nova-compute[71026]: node.session.initial_cmdsn = 0
Jul 27 16:38:24 user nova-compute[71026]: node.session.initial_login_retry_max = 8
Jul 27 16:38:24 user nova-compute[71026]: node.session.xmit_thread_priority = -20
Jul 27 16:38:24 user nova-compute[71026]: node.session.cmds_max = 128
Jul 27 16:38:24 user nova-compute[71026]: node.session.queue_depth = 32
Jul 27 16:38:24 user nova-compute[71026]: node.session.nr_sessions = 1
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.authmethod = CHAP
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.username = wYSOsuKg
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.password = ***
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.username_in = <empty>
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.password_in = <empty>
Jul 27 16:38:24 user nova-compute[71026]: node.session.auth.chap_algs = MD5
Jul 27 16:38:24 user nova-compute[71026]: node.session.timeo.replacement_timeout = 120
Jul 27 16:38:24 user nova-compute[71026]: node.session.err_timeo.abort_timeout = 15
Jul 27 16:38:24 user nova-compute[71026]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 16:38:24 user nova-compute[71026]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 16:38:24 user nova-compute[71026]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.FastAbort = Yes
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.InitialR2T = No
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.ImmediateData = Yes
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.MaxConnections = 1
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 16:38:24 user nova-compute[71026]: node.session.iscsi.ERL = 0
Jul 27 16:38:24 user nova-compute[71026]: node.session.scan = manual
Jul 27 16:38:24 user nova-compute[71026]: node.session.reopen_max = 0
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].address = 172.16.0.220
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].port = 3260
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].startup = manual
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].tcp.window_size = 524288
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].tcp.type_of_service = 0
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].timeo.logout_timeout = 15
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].timeo.login_timeout = 15
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].timeo.auth_timeout = 45
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.DataDigest = None
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.IFMarker = No
Jul 27 16:38:24 user nova-compute[71026]: node.conn[0].iscsi.OFMarker = No
Jul 27 16:38:24 user nova-compute[71026]: # END RECORD
Jul 27 16:38:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabb0bf4-cd7c-46e4-a918-43b549cbd97b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc79a9-68cf-4a10-a926-2d377c7ff6bc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYSOsuKg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wYSOsuKg" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab844e7-c5f9-43f5-a73e-fccf39a57b7a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wYSOsuKg'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dd8f7f-530b-43a1-badd-202008e2dadb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d84828-8a8e-4f50-8fd8-d3b6d2ffd13d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7690c-fb57-484d-8c6c-3ae371ec4a82]: (4, ('0 0 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] <== connect_volume: return (180ms) {'type': 'block', 'scsi_wwn': '26430626231313530', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430626231313530', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1261262759',display_name='tempest-ServerStableDeviceRescueTest-server-1261262759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1261262759',id=2,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLebzHT/ReLmyfHAdUDB+s5h41G6i1UV5+T2SutRBvBUAIHSxj5VOaNMFZJPVUjELdhNWD+XxOHbDEq+7+e0o2WOkTYoaKLr5EuwjT5kTOxp1j39vRQvjDNzn98rHbGmQg==',key_name='tempest-keypair-828655165',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef5c245d5fe404083a2bf9b9f5060d0',ramdisk_id='',reservation_id='r-zn2vf2lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1901406311',owner_user_name='tempest-ServerStableDeviceRescueTest-1901406311-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:36:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7cdfafb6ab941ff86123b2f0dba6d77',uuid=1015a1e1-69ee-42a0-acf9-597323751110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "vif_mac": "fa:16:3e:15:10:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converting VIF {"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "vif_mac": "fa:16:3e:15:10:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'pci_devices' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:38:24 user nova-compute[71026]:   <uuid>1015a1e1-69ee-42a0-acf9-597323751110</uuid>
Jul 27 16:38:24 user nova-compute[71026]:   <name>instance-00000002</name>
Jul 27 16:38:24 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:38:24 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:38:24 user nova-compute[71026]:   <metadata>
Jul 27 16:38:24 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:38:24 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1261262759</nova:name>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:38:24</nova:creationTime>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:38:24 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:38:24 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:owner>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:user uuid="d7cdfafb6ab941ff86123b2f0dba6d77">tempest-ServerStableDeviceRescueTest-1901406311-project-member</nova:user>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:project uuid="bef5c245d5fe404083a2bf9b9f5060d0">tempest-ServerStableDeviceRescueTest-1901406311</nova:project>
Jul 27 16:38:24 user nova-compute[71026]:       </nova:owner>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:38:24 user nova-compute[71026]:       <nova:ports>
Jul 27 16:38:24 user nova-compute[71026]:         <nova:port uuid="4e3e2fd1-45b3-46ee-85e8-0692ac6994ee">
Jul 27 16:38:24 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:38:24 user nova-compute[71026]:         </nova:port>
Jul 27 16:38:24 user nova-compute[71026]:       </nova:ports>
Jul 27 16:38:24 user nova-compute[71026]:     </nova:instance>
Jul 27 16:38:24 user nova-compute[71026]:   </metadata>
Jul 27 16:38:24 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:38:24 user nova-compute[71026]:     <system>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="serial">1015a1e1-69ee-42a0-acf9-597323751110</entry>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="uuid">1015a1e1-69ee-42a0-acf9-597323751110</entry>
Jul 27 16:38:24 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:38:24 user nova-compute[71026]:     </system>
Jul 27 16:38:24 user nova-compute[71026]:   </sysinfo>
Jul 27 16:38:24 user nova-compute[71026]:   <os>
Jul 27 16:38:24 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:38:24 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:38:24 user nova-compute[71026]:   </os>
Jul 27 16:38:24 user nova-compute[71026]:   <features>
Jul 27 16:38:24 user nova-compute[71026]:     <acpi/>
Jul 27 16:38:24 user nova-compute[71026]:     <apic/>
Jul 27 16:38:24 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:38:24 user nova-compute[71026]:   </features>
Jul 27 16:38:24 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:38:24 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:38:24 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:38:24 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:38:24 user nova-compute[71026]:   </clock>
Jul 27 16:38:24 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:38:24 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:38:24 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:38:24 user nova-compute[71026]:   </cpu>
Jul 27 16:38:24 user nova-compute[71026]:   <devices>
Jul 27 16:38:24 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:38:24 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:38:24 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk"/>
Jul 27 16:38:24 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:38:24 user nova-compute[71026]:     </disk>
Jul 27 16:38:24 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:38:24 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:38:24 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:38:24 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:38:24 user nova-compute[71026]:       <serial>3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9</serial>
Jul 27 16:38:24 user nova-compute[71026]:     </disk>
Jul 27 16:38:24 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:38:24 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:38:24 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue"/>
Jul 27 16:38:24 user nova-compute[71026]:       <target dev="vdc" bus="virtio"/>
Jul 27 16:38:24 user nova-compute[71026]:       <boot order="1"/>
Jul 27 16:38:24 user nova-compute[71026]:     </disk>
Jul 27 16:38:24 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:38:24 user nova-compute[71026]:       <mac address="fa:16:3e:15:10:68"/>
Jul 27 16:38:24 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:24 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:38:24 user nova-compute[71026]:       <target dev="tap4e3e2fd1-45"/>
Jul 27 16:38:24 user nova-compute[71026]:     </interface>
Jul 27 16:38:24 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:38:24 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/console.log" append="off"/>
Jul 27 16:38:24 user nova-compute[71026]:     </serial>
Jul 27 16:38:24 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:38:24 user nova-compute[71026]:     <video>
Jul 27 16:38:24 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:24 user nova-compute[71026]:     </video>
Jul 27 16:38:24 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:38:24 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:38:24 user nova-compute[71026]:     </rng>
Jul 27 16:38:24 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:38:24 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:38:24 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:38:24 user nova-compute[71026]:     </memballoon>
Jul 27 16:38:24 user nova-compute[71026]:   </devices>
Jul 27 16:38:24 user nova-compute[71026]: </domain>
Jul 27 16:38:24 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:38:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance destroyed successfully.
Jul 27 16:38:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] No VIF found with MAC fa:16:3e:15:10:68, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:38:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:26 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:26 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:26 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15edf428-ff87-4fa6-b7ce-bf226b998f86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:38:26 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fae8a3-3378-4958-aec7-dfcd8b96af96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e2c4b-e18c-4575-bb33-5136af61dd68]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f82c24-021f-49a0-97ee-9b03a77e6b71]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be9061b-7a05-4ad1-aba2-0ab5cce32cea]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECbozTuR'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906ee12-dc95-4304-9950-cae01ef45524]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce545eea-d4dc-4a4a-a2ed-251ec87f7997]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a1d7a-d990-406a-9421-48cf8caeede9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:38:26 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63214f-1eb2-4d05-9050-045ed0d33dc6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfabbf1-2aac-42db-8dab-be0eaa5d6d8b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90fe516-2986-4e9b-b85a-6a83be87e89e]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:26 user nova-compute[71026]: WARNING nova.compute.manager [req-519bdb10-324a-4b56-8f05-1c4b265e91c9 req-f8c664bc-d949-4107-ae60-d20bf142bdab service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'flavor' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:38:27 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:38:27 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:38:27 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:38:27 user nova-compute[71026]:   <serial>9d46bf45-57e8-4cdb-bebe-11c2f0dec979</serial>
Jul 27 16:38:27 user nova-compute[71026]: </disk>
Jul 27 16:38:27 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No VIF found with MAC fa:16:3e:cb:e0:30, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a378c572-1c70-485e-a133-7d912042d427 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.585s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:28 user nova-compute[71026]: WARNING nova.compute.manager [req-93ac2cf0-bca4-49f9-ba3e-54301838449a req-b8a7fb9e-c019-432f-afa1-6eb1ccdfda1c service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state rescuing.
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 1015a1e1-69ee-42a0-acf9-597323751110 due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475908.908008, 1015a1e1-69ee-42a0-acf9-597323751110 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Resumed (Lifecycle Event)
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-48c30c11-d7f7-411e-94a8-70d584d7d3ac tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475908.9104624, 1015a1e1-69ee-42a0-acf9-597323751110 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:28 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Started (Lifecycle Event)
Jul 27 16:38:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Stashing vm_state: active {{(pid=71026) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'pci_requests' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:38:30 user nova-compute[71026]: INFO nova.compute.claims [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Claim successful on node user
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'resources' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'pci_devices' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:30 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating resource usage from migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.615s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:30 user nova-compute[71026]: INFO nova.compute.manager [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Migrating
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:30 user nova-compute[71026]: INFO nova.compute.rpcapi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:31 user nova-compute[71026]: INFO nova.compute.manager [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Terminating instance
Jul 27 16:38:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-unplugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] No waiting events found dispatching network-vif-unplugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-43aa4c6e-cace-4d2f-97ef-5d5566cb343f req-272e0ce1-341d-4e1a-a44d-3d099cace3ba service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-unplugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Starting migrate_disk_and_power_off {{(pid=71026) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 16:38:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Instance destroyed successfully.
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.objects.instance [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lazy-loading 'resources' on Instance uuid 4256bebd-a216-46e4-acd9-fa7fe38422cd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:35:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1639480165',display_name='tempest-TestVolumeSwap-server-1639480165',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1639480165',id=9,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3vm4gidxK0l1ev82G1Qi/XOB49a3+xTWAf/ybiykqYj0vGAz0onwBnVez594nphSs5v3tLz28ltO+WWGbtW+F4kL9UCx3dqNsiAWsu4uam964xDXUkk7gZm/+KHLH4Gg==',key_name='tempest-keypair-1263266121',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:35:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='427f14c9239c4e8fbc7751d600cbb5d3',ramdisk_id='',reservation_id='r-u4ezci17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1117520652',owner_user_name='tempest-TestVolumeSwap-1117520652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:35:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='007fca7e89604eedad55092edd0ee200',uuid=4256bebd-a216-46e4-acd9-fa7fe38422cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converting VIF {"id": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "address": "fa:16:3e:0d:be:0d", "network": {"id": "4014939c-f807-40d3-b739-9c24fef7b3ee", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1014170565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "427f14c9239c4e8fbc7751d600cbb5d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e50cdea-51", "ovs_interfaceid": "1e50cdea-515a-49c8-8d7b-264e6cd04cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG os_vif [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e50cdea-51, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: INFO os_vif [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:be:0d,bridge_name='br-int',has_traffic_filtering=True,id=1e50cdea-515a-49c8-8d7b-264e6cd04cd0,network=Network(4014939c-f807-40d3-b739-9c24fef7b3ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e50cdea-51')
Jul 27 16:38:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Deleting instance files /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd_del
Jul 27 16:38:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Deletion of /opt/stack/data/nova/instances/4256bebd-a216-46e4-acd9-fa7fe38422cd_del complete
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: INFO nova.compute.manager [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 27 16:38:32 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:32 user nova-compute[71026]: WARNING nova.compute.manager [req-c2475f22-52bc-4b1b-9e25-8fb3398f3172 req-f319a7c2-79c2-4490-9c2f-078b6627a506 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state active and task_state resize_migrating.
Jul 27 16:38:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance destroyed successfully.
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG os_vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd736b7-da, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:38:33 user nova-compute[71026]: INFO os_vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:38:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:33 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[595a9027-093c-4432-a116-a3a34237be75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:38:33 user nova-compute[71026]: No targets found.
Jul 27 16:38:33 user nova-compute[71026]: iSNS:
Jul 27 16:38:33 user nova-compute[71026]: No targets found.
Jul 27 16:38:33 user nova-compute[71026]: STATIC:
Jul 27 16:38:33 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:38:33 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:38:33 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:38:33 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:38:33 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:38:33 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:38:33 user nova-compute[71026]: FIRMWARE:
Jul 27 16:38:33 user nova-compute[71026]: No targets found.
Jul 27 16:38:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:38:33 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:38:33 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8adcc-b15b-43bf-84a8-85778dc8971b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10898430-0133-4438-9a25-936330e3b5d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:33 user nova-compute[71026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:33 user nova-compute[71026]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885e9d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ff1cff-ed0f-4ef4-9abf-7d5554c60f00]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[941ca65d-98c4-4798-b171-153320baaf8c]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b0f6f0-ed9c-41b0-9220-67245e989549]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84111a4-3366-4191-879e-9c595d26b6ad]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d9d2c-b4dc-425a-b363-880ab09d971d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9f2baf-e0d3-4c0f-ba70-d2c5343e4550]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:38:33 user nova-compute[71026]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:38:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc06590e-45df-4c2d-8ded-1eff92982493]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== disconnect_volume: return (349ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] Acquiring lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] No waiting events found dispatching network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:33 user nova-compute[71026]: WARNING nova.compute.manager [req-68631257-c0d0-46fd-b2f0-ba356689fe53 req-d41d39dc-f67b-4a4b-aa0c-3aa598619db0 service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received unexpected event network-vif-plugged-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 for instance with vm_state active and task_state deleting.
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:38:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_resize/disk /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "cp -r /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_resize/disk /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk" returned: 0 in 0.346s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_resize/disk.info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk.info {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "cp -r /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_resize/disk.info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk.info" returned: 0 in 0.035s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:34 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Took 1.90 seconds to deallocate network for instance.
Jul 27 16:38:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:38:34 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:35 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Deleted allocations for instance 4256bebd-a216-46e4-acd9-fa7fe38422cd
Jul 27 16:38:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:35 user nova-compute[71026]: WARNING nova.compute.manager [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state active and task_state resize_migrating.
Jul 27 16:38:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad61d841-6dc0-40cd-ab4e-d27cffb91982 req-0e75e579-fe49-430e-a45c-f0794eaf053f service nova] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Received event network-vif-deleted-1e50cdea-515a-49c8-8d7b-264e6cd04cd0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-471ee122-f384-41cf-946e-1075eb26618c tempest-TestVolumeSwap-1117520652 tempest-TestVolumeSwap-1117520652-project-member] Lock "4256bebd-a216-46e4-acd9-fa7fe38422cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.158s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Port dbd736b7-dabf-4687-845b-afd30024718d binding to destination host user is already ACTIVE {{(pid=71026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.utils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d29fac-2ed5-4c86-8b7a-fb81705b128b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de09e5-ca9e-4854-abac-1dca7ab238f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca95eaa-9a68-4917-b9a3-b7f95cb9f642]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb47ee97-59f4-428d-bc90-a74182d7cb01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:36 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:38:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3686ce-2e6d-4bc3-95fe-d576bef884f1]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:38:36 user nova-compute[71026]: DEBUG os_brick.utils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Starting finish_migration {{(pid=71026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:38:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Creating image(s)
Jul 27 16:38:44 user nova-compute[71026]: DEBUG nova.objects.instance [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'trusted_certs' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk. size=21474836480 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:38:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk 21474836480 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk 21474836480" returned: 0 in 0.272s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Ensure instance console log exists: /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start _get_guest_xml network_info=[{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd217a197-c640-45e3-847f-e692ded760d8', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '790cd259-4d88-427a-acf4-d4d70c9fc8d1', 'attached_at': '2023-07-27T16:38:44.000000', 'detached_at': '', 'volume_id': '9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'serial': '9d46bf45-57e8-4cdb-bebe-11c2f0dec979'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:38:45 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:45 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.objects.instance [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'vcpu_model' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:38:45 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7957a607-5cbc-47a1-9efb-b14a6ae357ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:38:45 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4727706-df9e-4bb6-b77e-7697536625dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42e08ec-cede-4181-be4c-d627742f9530]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f6949-1324-48ed-9ae1-3695e8680343]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d101b7d-704b-4e05-950f-92bc6f90258e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECbozTuR'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e014cce-5112-4d31-899d-c0a6d4380f24]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61323ae5-c4a4-408a-aee0-c5d1a3300966]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cd01b4-9cb8-4ef3-9b6c-1397fee5f930]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:38:45 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[958fadd6-1b81-4917-9df8-47871c159a0d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941fe00-5011-41a6-96b5-d2d46687cf68]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:38:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed842070-f8b9-4eae-abb3-3972ab4a1a72]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:38:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:38:46 user nova-compute[71026]:   <uuid>790cd259-4d88-427a-acf4-d4d70c9fc8d1</uuid>
Jul 27 16:38:46 user nova-compute[71026]:   <name>instance-00000006</name>
Jul 27 16:38:46 user nova-compute[71026]:   <memory>2097152</memory>
Jul 27 16:38:46 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:38:46 user nova-compute[71026]:   <metadata>
Jul 27 16:38:46 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:38:46 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherB-server-1556874473</nova:name>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:38:45</nova:creationTime>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:flavor name="m1.small">
Jul 27 16:38:46 user nova-compute[71026]:         <nova:memory>2048</nova:memory>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:disk>20</nova:disk>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:38:46 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:owner>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:user uuid="145d143ed66e4ddd9708b36e6ddeeb09">tempest-ServerActionsTestOtherB-496611114-project-member</nova:user>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:project uuid="ff31b3d25a99410aab34dff6c445ff44">tempest-ServerActionsTestOtherB-496611114</nova:project>
Jul 27 16:38:46 user nova-compute[71026]:       </nova:owner>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:38:46 user nova-compute[71026]:       <nova:ports>
Jul 27 16:38:46 user nova-compute[71026]:         <nova:port uuid="dbd736b7-dabf-4687-845b-afd30024718d">
Jul 27 16:38:46 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:38:46 user nova-compute[71026]:         </nova:port>
Jul 27 16:38:46 user nova-compute[71026]:       </nova:ports>
Jul 27 16:38:46 user nova-compute[71026]:     </nova:instance>
Jul 27 16:38:46 user nova-compute[71026]:   </metadata>
Jul 27 16:38:46 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:38:46 user nova-compute[71026]:     <system>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="serial">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="uuid">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:38:46 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:38:46 user nova-compute[71026]:     </system>
Jul 27 16:38:46 user nova-compute[71026]:   </sysinfo>
Jul 27 16:38:46 user nova-compute[71026]:   <os>
Jul 27 16:38:46 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:38:46 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:38:46 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:38:46 user nova-compute[71026]:   </os>
Jul 27 16:38:46 user nova-compute[71026]:   <features>
Jul 27 16:38:46 user nova-compute[71026]:     <acpi/>
Jul 27 16:38:46 user nova-compute[71026]:     <apic/>
Jul 27 16:38:46 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:38:46 user nova-compute[71026]:   </features>
Jul 27 16:38:46 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:38:46 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:38:46 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:38:46 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:38:46 user nova-compute[71026]:   </clock>
Jul 27 16:38:46 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:38:46 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:38:46 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:38:46 user nova-compute[71026]:   </cpu>
Jul 27 16:38:46 user nova-compute[71026]:   <devices>
Jul 27 16:38:46 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:38:46 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:38:46 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk"/>
Jul 27 16:38:46 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:38:46 user nova-compute[71026]:     </disk>
Jul 27 16:38:46 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:38:46 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:38:46 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:38:46 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:38:46 user nova-compute[71026]:       <serial>9d46bf45-57e8-4cdb-bebe-11c2f0dec979</serial>
Jul 27 16:38:46 user nova-compute[71026]:     </disk>
Jul 27 16:38:46 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:38:46 user nova-compute[71026]:       <mac address="fa:16:3e:cb:e0:30"/>
Jul 27 16:38:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:46 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:38:46 user nova-compute[71026]:       <target dev="tapdbd736b7-da"/>
Jul 27 16:38:46 user nova-compute[71026]:     </interface>
Jul 27 16:38:46 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:38:46 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/console.log" append="off"/>
Jul 27 16:38:46 user nova-compute[71026]:     </serial>
Jul 27 16:38:46 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:38:46 user nova-compute[71026]:     <video>
Jul 27 16:38:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:38:46 user nova-compute[71026]:     </video>
Jul 27 16:38:46 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:38:46 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:38:46 user nova-compute[71026]:     </rng>
Jul 27 16:38:46 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:38:46 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:38:46 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:38:46 user nova-compute[71026]:     </memballoon>
Jul 27 16:38:46 user nova-compute[71026]:   </devices>
Jul 27 16:38:46 user nova-compute[71026]: </domain>
Jul 27 16:38:46 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-193041218-network", "vif_mac": "fa:16:3e:cb:e0:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG os_vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd736b7-da, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbd736b7-da, col_values=(('external_ids', {'iface-id': 'dbd736b7-dabf-4687-845b-afd30024718d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e0:30', 'vm-uuid': '790cd259-4d88-427a-acf4-d4d70c9fc8d1'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:46 user nova-compute[71026]: INFO os_vif [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:38:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] No VIF found with MAC fa:16:3e:cb:e0:30, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475912.1306818, 4256bebd-a216-46e4-acd9-fa7fe38422cd => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:47 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] VM Stopped (Lifecycle Event)
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f36c134b-8e27-46ff-9d57-cf0c6e2b9648 None None] [instance: 4256bebd-a216-46e4-acd9-fa7fe38422cd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-changed-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Refreshing instance network info cache due to event network-changed-1c085f61-f6ff-4884-baab-101092898a1a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] Acquiring lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] Acquired lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Refreshing network info cache for port 1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:38:47 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475912.974522, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:47 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Stopped (Lifecycle Event)
Jul 27 16:38:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:48 user nova-compute[71026]: DEBUG nova.compute.manager [None req-744433fa-cad8-4426-9cc1-b8e8c6f05f37 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:49 user nova-compute[71026]: WARNING nova.compute.manager [req-602e6c9f-e32b-4b7c-87e7-9301562203b2 req-68435ee4-e4ed-4d8f-8c9b-50fbb74136c1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state active and task_state resize_finish.
Jul 27 16:38:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updated VIF entry in instance network info cache for port 1c085f61-f6ff-4884-baab-101092898a1a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating instance_info_cache with network_info: [{"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:38:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-47247600-0802-4e09-b0e0-7a3a52fe4175 req-a8d7ed26-24d8-42cf-8a73-2d728a42fb9c service nova] Releasing lock "refresh_cache-e6154c2b-855a-4baf-b3e0-e1dee76110b7" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:38:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475930.953836, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Resumed (Lifecycle Event)
Jul 27 16:38:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:38:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance running successfully.
Jul 27 16:38:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Failed to set time: agent not configured {{(pid=71026) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 16:38:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-11b0ec6e-a945-432d-8181-c96beac5cd11 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] finish_migration finished successfully. {{(pid=71026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:51 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475930.957247, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:38:51 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Started (Lifecycle Event)
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:38:51 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 16:38:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:38:51 user nova-compute[71026]: WARNING nova.compute.manager [req-4e837f0d-1913-4bc1-8ce8-38b8938d0714 req-876c2e32-2def-4834-9e7d-6ad18d9407a7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state resized and task_state None.
Jul 27 16:38:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:53 user nova-compute[71026]: INFO nova.compute.manager [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attaching volume 16e2d681-63d7-4969-8033-c5c4b12f215e to /dev/vdb
Jul 27 16:38:53 user nova-compute[71026]: DEBUG os_brick.utils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442ff31-768c-4873-8de5-cefc11097a31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[896a2377-9463-44f6-98e1-99db2a1b16d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a2dd6-7d25-43f9-b5ad-c9ed8bee19d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a82cf-f508-4759-91ed-22350cdac170]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:38:54 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:38:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87522a5-5ba2-443e-b239-f38562a61646]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG os_brick.utils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating existing volume attachment record: 076dd944-e501-499f-9c35-e6981d05f252 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:38:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:38:56 user nova-compute[71026]: INFO nova.compute.claims [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Claim successful on node user
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:38:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:38:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:38:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Creating image(s)
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "/opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "/opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.policy [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5dcb248d3f3459d88d03dc648b5d9a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db945827a65a468eab6ebd4660b0d73c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk 1073741824" returned: 0 in 0.053s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Cannot resize image /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lazy-loading 'migration_context' on Instance uuid bc540607-05a8-4a2f-b949-6ddb89eb821d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Ensure instance console log exists: /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:38:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:38:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Successfully created port: 322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:38:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Successfully updated port: 322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquired lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-changed-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Refreshing instance network info cache due to event network-changed-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:38:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] Acquiring lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Updating instance_info_cache with network_info: [{"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Releasing lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Instance network_info: |[{"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] Acquired lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Refreshing network info cache for port 322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Start _get_guest_xml network_info=[{"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:39:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1959557686',display_name='tempest-VolumesActionsTest-instance-1959557686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1959557686',id=16,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db945827a65a468eab6ebd4660b0d73c',ramdisk_id='',reservation_id='r-kl7poj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-626397135',owner_user_name='tempest-VolumesActionsTest-626397135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:38:57Z,user_data=None,user_id='d5dcb248d3f3459d88d03dc648b5d9a8',uuid=bc540607-05a8-4a2f-b949-6ddb89eb821d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converting VIF {"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lazy-loading 'pci_devices' on Instance uuid bc540607-05a8-4a2f-b949-6ddb89eb821d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:39:00 user nova-compute[71026]:   <uuid>bc540607-05a8-4a2f-b949-6ddb89eb821d</uuid>
Jul 27 16:39:00 user nova-compute[71026]:   <name>instance-00000010</name>
Jul 27 16:39:00 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:39:00 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:39:00 user nova-compute[71026]:   <metadata>
Jul 27 16:39:00 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:39:00 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:name>tempest-VolumesActionsTest-instance-1959557686</nova:name>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:39:00</nova:creationTime>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:39:00 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:39:00 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:owner>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:user uuid="d5dcb248d3f3459d88d03dc648b5d9a8">tempest-VolumesActionsTest-626397135-project-member</nova:user>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:project uuid="db945827a65a468eab6ebd4660b0d73c">tempest-VolumesActionsTest-626397135</nova:project>
Jul 27 16:39:00 user nova-compute[71026]:       </nova:owner>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:39:00 user nova-compute[71026]:       <nova:ports>
Jul 27 16:39:00 user nova-compute[71026]:         <nova:port uuid="322c9233-ad7b-43ac-9c9c-4f402f8bcdc3">
Jul 27 16:39:00 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:39:00 user nova-compute[71026]:         </nova:port>
Jul 27 16:39:00 user nova-compute[71026]:       </nova:ports>
Jul 27 16:39:00 user nova-compute[71026]:     </nova:instance>
Jul 27 16:39:00 user nova-compute[71026]:   </metadata>
Jul 27 16:39:00 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:39:00 user nova-compute[71026]:     <system>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="serial">bc540607-05a8-4a2f-b949-6ddb89eb821d</entry>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="uuid">bc540607-05a8-4a2f-b949-6ddb89eb821d</entry>
Jul 27 16:39:00 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:39:00 user nova-compute[71026]:     </system>
Jul 27 16:39:00 user nova-compute[71026]:   </sysinfo>
Jul 27 16:39:00 user nova-compute[71026]:   <os>
Jul 27 16:39:00 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:39:00 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:39:00 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:39:00 user nova-compute[71026]:   </os>
Jul 27 16:39:00 user nova-compute[71026]:   <features>
Jul 27 16:39:00 user nova-compute[71026]:     <acpi/>
Jul 27 16:39:00 user nova-compute[71026]:     <apic/>
Jul 27 16:39:00 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:39:00 user nova-compute[71026]:   </features>
Jul 27 16:39:00 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:39:00 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:39:00 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:39:00 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:39:00 user nova-compute[71026]:   </clock>
Jul 27 16:39:00 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:39:00 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:39:00 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:39:00 user nova-compute[71026]:   </cpu>
Jul 27 16:39:00 user nova-compute[71026]:   <devices>
Jul 27 16:39:00 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:39:00 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:39:00 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk"/>
Jul 27 16:39:00 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:39:00 user nova-compute[71026]:     </disk>
Jul 27 16:39:00 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:39:00 user nova-compute[71026]:       <mac address="fa:16:3e:e0:2f:5b"/>
Jul 27 16:39:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:00 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:39:00 user nova-compute[71026]:       <target dev="tap322c9233-ad"/>
Jul 27 16:39:00 user nova-compute[71026]:     </interface>
Jul 27 16:39:00 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:39:00 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/console.log" append="off"/>
Jul 27 16:39:00 user nova-compute[71026]:     </serial>
Jul 27 16:39:00 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:39:00 user nova-compute[71026]:     <video>
Jul 27 16:39:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:00 user nova-compute[71026]:     </video>
Jul 27 16:39:00 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:39:00 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:39:00 user nova-compute[71026]:     </rng>
Jul 27 16:39:00 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:39:00 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:39:00 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:39:00 user nova-compute[71026]:     </memballoon>
Jul 27 16:39:00 user nova-compute[71026]:   </devices>
Jul 27 16:39:00 user nova-compute[71026]: </domain>
Jul 27 16:39:00 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1959557686',display_name='tempest-VolumesActionsTest-instance-1959557686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1959557686',id=16,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db945827a65a468eab6ebd4660b0d73c',ramdisk_id='',reservation_id='r-kl7poj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-626397135',owner_user_name='tempest-VolumesActionsTest-626397135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:38:57Z,user_data=None,user_id='d5dcb248d3f3459d88d03dc648b5d9a8',uuid=bc540607-05a8-4a2f-b949-6ddb89eb821d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converting VIF {"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG os_vif [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap322c9233-ad, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap322c9233-ad, col_values=(('external_ids', {'iface-id': '322c9233-ad7b-43ac-9c9c-4f402f8bcdc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:2f:5b', 'vm-uuid': 'bc540607-05a8-4a2f-b949-6ddb89eb821d'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:00 user nova-compute[71026]: INFO os_vif [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad')
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] No VIF found with MAC fa:16:3e:e0:2f:5b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:39:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Updated VIF entry in instance network info cache for port 322c9233-ad7b-43ac-9c9c-4f402f8bcdc3. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:39:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Updating instance_info_cache with network_info: [{"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-aa3677c3-f929-47bc-bf79-26d19063dbc4 req-56c576c5-ade5-425c-a4b5-a395dd38613d service nova] Releasing lock "refresh_cache-bc540607-05a8-4a2f-b949-6ddb89eb821d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuTxjWSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:39:02 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:39:02 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:39:02 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:39:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d17fe25-629e-4bb9-bcdf-e0b828ce5939]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:39:02 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce63fb6-df31-4fc4-bce4-24d1693d7cee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e] added
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de6288-06da-40ea-b8f4-17ca611e0793]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3eb98-f14e-4949-bb03-f3cbe932ef4d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuTxjWSN {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuTxjWSN" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4bac4-97ac-4ac7-ba12-b382d975bf4e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MuTxjWSN'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a42e4e-fdcd-4d7d-9ce1-be3dfd24e08b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5419a9a-c0e4-4ca0-97c4-a7ed21bbec77]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08aa2b8a-4e40-4b99-b531-1d23338a5b1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260]
Jul 27 16:39:02 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260] successful.
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e2690-221a-4d52-b075-0282c131e33a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c464d-bc64-405b-8b54-6f66965ea72e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:02 user nova-compute[71026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)
Jul 27 16:39:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeca8a0-5188-4607-91f7-17c7bab69886]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuTxjWSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] No waiting events found dispatching network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:03 user nova-compute[71026]: WARNING nova.compute.manager [req-58ee2d54-46f2-47bc-ba28-9c5e9b82e679 req-cd7146ba-2729-4896-b6dd-883a1eef5843 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received unexpected event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 for instance with vm_state building and task_state spawning.
Jul 27 16:39:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26331343535306563', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343535306563', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:39:03 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:39:03 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:39:03 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:39:03 user nova-compute[71026]:   <serial>16e2d681-63d7-4969-8033-c5c4b12f215e</serial>
Jul 27 16:39:03 user nova-compute[71026]: </disk>
Jul 27 16:39:03 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No VIF found with MAC fa:16:3e:70:6e:3a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b007c10a-458c-4c35-a765-5e6fed085091 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.351s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475944.4365804, bc540607-05a8-4a2f-b949-6ddb89eb821d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] VM Resumed (Lifecycle Event)
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Instance spawned successfully.
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475944.4380631, bc540607-05a8-4a2f-b949-6ddb89eb821d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] VM Started (Lifecycle Event)
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Took 7.47 seconds to spawn the instance on the hypervisor.
Jul 27 16:39:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:04 user nova-compute[71026]: INFO nova.compute.manager [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Took 8.40 seconds to build instance.
Jul 27 16:39:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e65786a-26b1-4cb8-ad85-ee5e67294818 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.507s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] No waiting events found dispatching network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:05 user nova-compute[71026]: WARNING nova.compute.manager [req-8a28a6d1-5fec-4aa9-b7e7-c63b70875b86 req-722ccc6b-ee0b-4364-9d89-df10273ae9d3 service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received unexpected event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 for instance with vm_state active and task_state None.
Jul 27 16:39:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:39:09 user nova-compute[71026]: INFO nova.compute.claims [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Claim successful on node user
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:39:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.policy [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e106be16f498443091e8ae9f95311beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b15450553d464cbeac2d3d910e8043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:39:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Creating image(s)
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk 1073741824" returned: 0 in 0.049s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Successfully created port: edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Cannot resize image /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'migration_context' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Ensure instance console log exists: /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:11 user nova-compute[71026]: INFO nova.compute.manager [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Rescuing
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:11 user nova-compute[71026]: DEBUG nova.network.neutron [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Successfully updated port: edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-changed-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing instance network info cache due to event network-changed-edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance network_info: |[{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing network info cache for port edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start _get_guest_xml network_info=[{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:39:12 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:12 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-230134682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_devices' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:39:12 user nova-compute[71026]:   <uuid>3037d3ff-300a-42b0-a022-3aa1e9df52a6</uuid>
Jul 27 16:39:12 user nova-compute[71026]:   <name>instance-00000011</name>
Jul 27 16:39:12 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:39:12 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:39:12 user nova-compute[71026]:   <metadata>
Jul 27 16:39:12 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:39:12 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherA-server-230134682</nova:name>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:39:12</nova:creationTime>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:39:12 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:39:12 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:owner>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:user uuid="e106be16f498443091e8ae9f95311beb">tempest-ServerActionsTestOtherA-1832986311-project-member</nova:user>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:project uuid="40b15450553d464cbeac2d3d910e8043">tempest-ServerActionsTestOtherA-1832986311</nova:project>
Jul 27 16:39:12 user nova-compute[71026]:       </nova:owner>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:39:12 user nova-compute[71026]:       <nova:ports>
Jul 27 16:39:12 user nova-compute[71026]:         <nova:port uuid="edd92f92-526b-4110-9219-7dce34224f86">
Jul 27 16:39:12 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 16:39:12 user nova-compute[71026]:         </nova:port>
Jul 27 16:39:12 user nova-compute[71026]:       </nova:ports>
Jul 27 16:39:12 user nova-compute[71026]:     </nova:instance>
Jul 27 16:39:12 user nova-compute[71026]:   </metadata>
Jul 27 16:39:12 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:39:12 user nova-compute[71026]:     <system>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="serial">3037d3ff-300a-42b0-a022-3aa1e9df52a6</entry>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="uuid">3037d3ff-300a-42b0-a022-3aa1e9df52a6</entry>
Jul 27 16:39:12 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:39:12 user nova-compute[71026]:     </system>
Jul 27 16:39:12 user nova-compute[71026]:   </sysinfo>
Jul 27 16:39:12 user nova-compute[71026]:   <os>
Jul 27 16:39:12 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:39:12 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:39:12 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:39:12 user nova-compute[71026]:   </os>
Jul 27 16:39:12 user nova-compute[71026]:   <features>
Jul 27 16:39:12 user nova-compute[71026]:     <acpi/>
Jul 27 16:39:12 user nova-compute[71026]:     <apic/>
Jul 27 16:39:12 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:39:12 user nova-compute[71026]:   </features>
Jul 27 16:39:12 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:39:12 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:39:12 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:39:12 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:39:12 user nova-compute[71026]:   </clock>
Jul 27 16:39:12 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:39:12 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:39:12 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:39:12 user nova-compute[71026]:   </cpu>
Jul 27 16:39:12 user nova-compute[71026]:   <devices>
Jul 27 16:39:12 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:39:12 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:39:12 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk"/>
Jul 27 16:39:12 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:39:12 user nova-compute[71026]:     </disk>
Jul 27 16:39:12 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:39:12 user nova-compute[71026]:       <mac address="fa:16:3e:7c:3e:82"/>
Jul 27 16:39:12 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:12 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:39:12 user nova-compute[71026]:       <target dev="tapedd92f92-52"/>
Jul 27 16:39:12 user nova-compute[71026]:     </interface>
Jul 27 16:39:12 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:39:12 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/console.log" append="off"/>
Jul 27 16:39:12 user nova-compute[71026]:     </serial>
Jul 27 16:39:12 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:39:12 user nova-compute[71026]:     <video>
Jul 27 16:39:12 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:12 user nova-compute[71026]:     </video>
Jul 27 16:39:12 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:39:12 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:39:12 user nova-compute[71026]:     </rng>
Jul 27 16:39:12 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:39:12 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:39:12 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:39:12 user nova-compute[71026]:     </memballoon>
Jul 27 16:39:12 user nova-compute[71026]:   </devices>
Jul 27 16:39:12 user nova-compute[71026]: </domain>
Jul 27 16:39:12 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-230134682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG os_vif [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd92f92-52, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedd92f92-52, col_values=(('external_ids', {'iface-id': 'edd92f92-526b-4110-9219-7dce34224f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:3e:82', 'vm-uuid': '3037d3ff-300a-42b0-a022-3aa1e9df52a6'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:12 user nova-compute[71026]: WARNING nova.compute.manager [req-61a79288-a707-4dee-982d-0751ae890edc req-2f4f56b9-7588-46b7-b88c-982a26f797f9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: INFO os_vif [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52')
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No VIF found with MAC fa:16:3e:7c:3e:82, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated VIF entry in instance network info cache for port edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ed4cf7a-6a9b-4953-889b-e59c7ed923fd req-3d83b878-2b1b-40ed-80ef-f477c42747d4 service nova] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance destroyed successfully.
Jul 27 16:39:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Attempting rescue
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:39:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Creating image(s)
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'trusted_certs' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.175s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue" returned: 0 in 0.062s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start _get_guest_xml network_info=[{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:db:d9:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'numa_topology' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'vcpu_model' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323839499',display_name='tempest-ServerRescueNegativeTestJSON-server-1323839499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323839499',id=3,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-dr4vxw0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:34:43Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=b991c2a5-894c-49e7-896c-69eb95eb84bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:db:d9:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:db:d9:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:39:13 user nova-compute[71026]:   <uuid>b991c2a5-894c-49e7-896c-69eb95eb84bd</uuid>
Jul 27 16:39:13 user nova-compute[71026]:   <name>instance-00000003</name>
Jul 27 16:39:13 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:39:13 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:39:13 user nova-compute[71026]:   <metadata>
Jul 27 16:39:13 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:39:13 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1323839499</nova:name>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:39:13</nova:creationTime>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:39:13 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:39:13 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:owner>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:39:13 user nova-compute[71026]:       </nova:owner>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:39:13 user nova-compute[71026]:       <nova:ports>
Jul 27 16:39:13 user nova-compute[71026]:         <nova:port uuid="d401c2c4-92ad-4060-a4bd-157e7ca89ef2">
Jul 27 16:39:13 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:39:13 user nova-compute[71026]:         </nova:port>
Jul 27 16:39:13 user nova-compute[71026]:       </nova:ports>
Jul 27 16:39:13 user nova-compute[71026]:     </nova:instance>
Jul 27 16:39:13 user nova-compute[71026]:   </metadata>
Jul 27 16:39:13 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:39:13 user nova-compute[71026]:     <system>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="serial">b991c2a5-894c-49e7-896c-69eb95eb84bd</entry>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="uuid">b991c2a5-894c-49e7-896c-69eb95eb84bd</entry>
Jul 27 16:39:13 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:39:13 user nova-compute[71026]:     </system>
Jul 27 16:39:13 user nova-compute[71026]:   </sysinfo>
Jul 27 16:39:13 user nova-compute[71026]:   <os>
Jul 27 16:39:13 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:39:13 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:39:13 user nova-compute[71026]:   </os>
Jul 27 16:39:13 user nova-compute[71026]:   <features>
Jul 27 16:39:13 user nova-compute[71026]:     <acpi/>
Jul 27 16:39:13 user nova-compute[71026]:     <apic/>
Jul 27 16:39:13 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:39:13 user nova-compute[71026]:   </features>
Jul 27 16:39:13 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:39:13 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:39:13 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:39:13 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:39:13 user nova-compute[71026]:   </clock>
Jul 27 16:39:13 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:39:13 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:39:13 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:39:13 user nova-compute[71026]:   </cpu>
Jul 27 16:39:13 user nova-compute[71026]:   <devices>
Jul 27 16:39:13 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:39:13 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:39:13 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue"/>
Jul 27 16:39:13 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:39:13 user nova-compute[71026]:     </disk>
Jul 27 16:39:13 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:39:13 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:39:13 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk"/>
Jul 27 16:39:13 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:39:13 user nova-compute[71026]:     </disk>
Jul 27 16:39:13 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:39:13 user nova-compute[71026]:       <mac address="fa:16:3e:db:d9:0c"/>
Jul 27 16:39:13 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:13 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:39:13 user nova-compute[71026]:       <target dev="tapd401c2c4-92"/>
Jul 27 16:39:13 user nova-compute[71026]:     </interface>
Jul 27 16:39:13 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:39:13 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/console.log" append="off"/>
Jul 27 16:39:13 user nova-compute[71026]:     </serial>
Jul 27 16:39:13 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:39:13 user nova-compute[71026]:     <video>
Jul 27 16:39:13 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:39:13 user nova-compute[71026]:     </video>
Jul 27 16:39:13 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:39:13 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:39:13 user nova-compute[71026]:     </rng>
Jul 27 16:39:13 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:39:13 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:39:13 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:39:13 user nova-compute[71026]:     </memballoon>
Jul 27 16:39:13 user nova-compute[71026]:   </devices>
Jul 27 16:39:13 user nova-compute[71026]: </domain>
Jul 27 16:39:13 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:39:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance destroyed successfully.
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:db:d9:0c, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:14 user nova-compute[71026]: WARNING nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:14 user nova-compute[71026]: WARNING nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:14 user nova-compute[71026]: WARNING nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:14 user nova-compute[71026]: WARNING nova.compute.manager [req-3cc17dd6-d5d8-4099-ba53-3f3b20b4c18c req-3c3ef26d-26ce-4851-a0f8-8d2b68a2b646 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:14 user nova-compute[71026]: WARNING nova.compute.manager [req-15222beb-309b-4b3d-bfac-41eccf9365b4 req-7f8a6301-df43-4ba6-8f2a-da103f1ec444 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state building and task_state spawning.
Jul 27 16:39:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:16 user nova-compute[71026]: WARNING nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:16 user nova-compute[71026]: WARNING nova.compute.manager [req-8c751bcf-3aa6-4e20-ab91-aea4a56b94db req-84dc17b2-8505-4878-8124-02f5267fce09 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state active and task_state rescuing.
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:17 user nova-compute[71026]: WARNING nova.compute.manager [req-c2e98562-3a92-43c9-9dfc-948aa55ca719 req-613ad356-6191-4b33-8e06-61d2ec12ff08 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state building and task_state spawning.
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475958.309038, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Resumed (Lifecycle Event)
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance spawned successfully.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475958.312468, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Started (Lifecycle Event)
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-edd28fc7-a359-4b49-b04f-58baa05d07c9 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Took 7.89 seconds to spawn the instance on the hypervisor.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for b991c2a5-894c-49e7-896c-69eb95eb84bd due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475958.3979263, b991c2a5-894c-49e7-896c-69eb95eb84bd => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Resumed (Lifecycle Event)
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Took 8.90 seconds to build instance.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690475958.3981328, b991c2a5-894c-49e7-896c-69eb95eb84bd => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:39:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Started (Lifecycle Event)
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f94f1c39-c2d6-4e51-bc3d-8c028cae9463 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:18 user nova-compute[71026]: WARNING nova.compute.manager [req-6eee6f98-bdab-4bdf-abaf-aebb18afd2ab req-c85c8997-9b90-40a6-a661-2ac3ca306457 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state rescued and task_state None.
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:22 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:22 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7135MB free_disk=25.613773345947266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Applying migration context for instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 as it has an incoming, in-progress migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2. Migration status is finished {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 16:39:22 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating resource usage from migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance ae684296-4f58-4329-a78d-0098769a937c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc540607-05a8-4a2f-b949-6ddb89eb821d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:39:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:39:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:39:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:24 user nova-compute[71026]: INFO nova.compute.manager [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Detaching volume 16e2d681-63d7-4969-8033-c5c4b12f215e
Jul 27 16:39:24 user nova-compute[71026]: INFO nova.virt.block_device [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attempting to driver detach volume 16e2d681-63d7-4969-8033-c5c4b12f215e from mountpoint /dev/vdb
Jul 27 16:39:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Attempting to detach device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:39:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:39:24 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:39:24 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:39:24 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:39:24 user nova-compute[71026]:   <serial>16e2d681-63d7-4969-8033-c5c4b12f215e</serial>
Jul 27 16:39:24 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:39:24 user nova-compute[71026]: </disk>
Jul 27 16:39:24 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:39:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config.
Jul 27 16:39:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:39:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:39:24 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:39:24 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:39:24 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:39:24 user nova-compute[71026]:   <serial>16e2d681-63d7-4969-8033-c5c4b12f215e</serial>
Jul 27 16:39:24 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:39:24 user nova-compute[71026]: </disk>
Jul 27 16:39:24 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690475965.2954943, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:39:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config.
Jul 27 16:39:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuTxjWSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:39:25 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07de16c-5fc5-49c3-b715-d18f6edcd649]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:39:25 user nova-compute[71026]: No targets found.
Jul 27 16:39:25 user nova-compute[71026]: iSNS:
Jul 27 16:39:25 user nova-compute[71026]: No targets found.
Jul 27 16:39:25 user nova-compute[71026]: STATIC:
Jul 27 16:39:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:39:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:39:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:39:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:39:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:39:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:39:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e
Jul 27 16:39:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:39:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:39:25 user nova-compute[71026]: FIRMWARE:
Jul 27 16:39:25 user nova-compute[71026]: No targets found.
Jul 27 16:39:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:39:25 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:39:25 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac09768-55b5-4cf4-ae42-0f3400f43f61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b9824d-c7ee-4637-90fd-c718a318f4cd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:25 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:25 user nova-compute[71026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)
Jul 27 16:39:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:39:25 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:39:25 user nova-compute[71026]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e (non-flash)
Jul 27 16:39:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088476b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3f3e74-eda4-4779-8c85-237dda1288e8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.114s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876696f-653b-4e20-b6c4-8da8a46e9328]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e10d710-9039-4078-b58e-c4bf80d1b52c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b401a-efea-4a43-9826-9864f9783c72]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a65eccc-c7f8-48ce-bcc3-80ea9b8cccb3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --logout" returned: 0 in 0.205s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f231d1-c599-462a-9151-f6bbee0429c0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260]
Jul 27 16:39:25 user nova-compute[71026]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e, portal: 172.16.0.220,3260] successful.
Jul 27 16:39:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16e2d681-63d7-4969-8033-c5c4b12f215e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac6793-f4ab-4c36-8bc9-9afc210fea2c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.614s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== disconnect_volume: return (616ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:39:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:39:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0d24006-a982-4645-9015-6cb6ba738be0 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.054s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-changed-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing instance network info cache due to event network-changed-64270317-1447-4426-b429-cf1a1f41e6f1. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:39:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing network info cache for port 64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "interface-ae684296-4f58-4329-a78d-0098769a937c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "interface-ae684296-4f58-4329-a78d-0098769a937c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'flavor' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updated VIF entry in instance network info cache for port 64270317-1447-4426-b429-cf1a1f41e6f1. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-06ff111d-9027-4035-a8b7-85874d6fd2dd req-ed66a4c4-fb8f-4999-8a35-079f34864e18 service nova] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'pci_requests' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:39:50 user nova-compute[71026]: DEBUG nova.policy [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79f44fae1caa4caa8a6d885d1d7ed62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed38129c3544646b88ae65cf73b552f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:39:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Successfully created port: 72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Successfully updated port: 72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-changed-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing instance network info cache due to event network-changed-72522f20-2619-421b-a896-7323c0ebc8e0. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Refreshing network info cache for port 72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG os_vif [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72522f20-26, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72522f20-26, col_values=(('external_ids', {'iface-id': '72522f20-2619-421b-a896-7323c0ebc8e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:27:b6', 'vm-uuid': 'ae684296-4f58-4329-a78d-0098769a937c'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:52 user nova-compute[71026]: INFO os_vif [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26')
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] attach device xml: <interface type="ethernet">
Jul 27 16:39:52 user nova-compute[71026]:   <mac address="fa:16:3e:43:27:b6"/>
Jul 27 16:39:52 user nova-compute[71026]:   <model type="virtio"/>
Jul 27 16:39:52 user nova-compute[71026]:   <mtu size="1442"/>
Jul 27 16:39:52 user nova-compute[71026]:   <target dev="tap72522f20-26"/>
Jul 27 16:39:52 user nova-compute[71026]: </interface>
Jul 27 16:39:52 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:39:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name hda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No VIF found with MAC fa:16:3e:41:55:6f, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:39:53 user nova-compute[71026]:   <nova:package version="0.0.0"/>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:name>tempest-device-tagging-server-1264265188</nova:name>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:creationTime>2023-07-27 16:39:53</nova:creationTime>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:flavor name="m1.tiny">
Jul 27 16:39:53 user nova-compute[71026]:     <nova:memory>512</nova:memory>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:disk>1</nova:disk>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:swap>0</nova:swap>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:vcpus>1</nova:vcpus>
Jul 27 16:39:53 user nova-compute[71026]:   </nova:flavor>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:owner>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:user uuid="79f44fae1caa4caa8a6d885d1d7ed62e">tempest-TaggedAttachmentsTest-10523810-project-member</nova:user>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:project uuid="fed38129c3544646b88ae65cf73b552f">tempest-TaggedAttachmentsTest-10523810</nova:project>
Jul 27 16:39:53 user nova-compute[71026]:   </nova:owner>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:39:53 user nova-compute[71026]:   <nova:ports>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:port uuid="64270317-1447-4426-b429-cf1a1f41e6f1">
Jul 27 16:39:53 user nova-compute[71026]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:39:53 user nova-compute[71026]:     </nova:port>
Jul 27 16:39:53 user nova-compute[71026]:     <nova:port uuid="72522f20-2619-421b-a896-7323c0ebc8e0">
Jul 27 16:39:53 user nova-compute[71026]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Jul 27 16:39:53 user nova-compute[71026]:     </nova:port>
Jul 27 16:39:53 user nova-compute[71026]:   </nova:ports>
Jul 27 16:39:53 user nova-compute[71026]: </nova:instance>
Jul 27 16:39:53 user nova-compute[71026]:  {{(pid=71026) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d91fbcc5-a16a-4f0d-9370-51da4a310778 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "interface-ae684296-4f58-4329-a78d-0098769a937c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.009s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updated VIF entry in instance network info cache for port 72522f20-2619-421b-a896-7323c0ebc8e0. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bffd9f5f-53be-49b3-bf6a-6ca1bb8a4cbb req-16b0cc8b-9bec-4387-8cd5-319a680afa5a service nova] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'flavor' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.compute.manager [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Attaching volume f88146f5-694b-4d28-89d3-856adfadc558 to /dev/vdb
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Terminating instance
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.utils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a01fc0b-a0b3-47df-9f28-6388173d7259]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbd1ba0-d46f-4af0-bc73-708dd0003ac0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e605114-0f7e-44e7-bdd5-84cd2ae4cccc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[565c7381-30a2-4a22-b943-a20ea7622ab1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:39:54 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6da971-4785-45c5-86c5-ea0cdd2ba744]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_brick.utils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating existing volume attachment record: c0f1ada0-501e-4ded-b1d0-9553580399bd {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:54 user nova-compute[71026]: WARNING nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 for instance with vm_state active and task_state None.
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:54 user nova-compute[71026]: WARNING nova.compute.manager [req-7c9beefb-1d93-4182-b50c-27da2b429bc8 req-9e262ea3-e84d-4c05-87e2-07ecade2c220 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 for instance with vm_state active and task_state None.
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-unplugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] No waiting events found dispatching network-vif-unplugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-5525198d-b101-4229-b0ad-20eb886b0f64 req-bab79958-7bc2-4a99-b609-05e2edcfb7b4 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-unplugged-27c322ab-47bd-4557-a5e0-b633a2581abd for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Instance destroyed successfully.
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'resources' on Instance uuid 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:37:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-396023020',display_name='tempest-VolumesAdminNegativeTest-server-396023020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-396023020',id=14,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-l9vcnmxd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:02Z,user_data=None,user_id='789e9b39aef14ae4af5a48148b92994d',uuid=3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "27c322ab-47bd-4557-a5e0-b633a2581abd", "address": "fa:16:3e:d2:70:0a", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c322ab-47", "ovs_interfaceid": "27c322ab-47bd-4557-a5e0-b633a2581abd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG os_vif [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27c322ab-47, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:54 user nova-compute[71026]: INFO os_vif [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:70:0a,bridge_name='br-int',has_traffic_filtering=True,id=27c322ab-47bd-4557-a5e0-b633a2581abd,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c322ab-47')
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Deleting instance files /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d_del
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Deletion of /opt/stack/data/nova/instances/3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d_del complete
Jul 27 16:39:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Took 0.72 seconds to destroy the instance on the hypervisor.
Jul 27 16:39:54 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:39:54 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:39:55 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:39:55 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Took 0.57 seconds to deallocate network for instance.
Jul 27 16:39:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:56 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Deleted allocations for instance 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d
Jul 27 16:39:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e377c210-de06-4c4e-93a1-f45d8c96d310 tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-6374e052-9e9b-4fc0-adef-499a4e247375 req-f5b2894a-e17a-464f-8a01-2fd844d6946b service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-deleted-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] Acquiring lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] Lock "3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:39:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] No waiting events found dispatching network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:39:56 user nova-compute[71026]: WARNING nova.compute.manager [req-6af9d3f9-738a-475d-a4f5-29beb215e5c4 req-ed5d96ba-ddf6-4b17-8e41-3ce30bb5de46 service nova] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Received unexpected event network-vif-plugged-27c322ab-47bd-4557-a5e0-b633a2581abd for instance with vm_state deleted and task_state None.
Jul 27 16:39:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:39:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIYXvNwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:01 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:01 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:01 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9030a7-5f3b-4ae5-9288-0e48ae2e1c56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:40:01 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941094f-3941-4060-9a9a-ab9fd19b6174]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558] added
Jul 27 16:40:01 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e999c1b-f0d8-4b5d-99ff-d6201a33e5ad]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9662b6e-bb03-4770-9cc2-84b0e61e1cdd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cIYXvNwO {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cIYXvNwO" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81b52cb-6376-46da-9d98-472e56b1984b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cIYXvNwO'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6fd8d-d87a-40f7-886d-072f4fbe2450]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f98d1-fc32-458a-ad80-35add7618131]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a207082-86db-446d-88da-8c5bf209c3a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260]
Jul 27 16:40:02 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e23aff-1fb9-4b99-a645-441a9a0d5752]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dba058-5331-481d-bf72-5435d5c3c270]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)
Jul 27 16:40:02 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b7dac-ebd2-4c9d-84c4-3497e0d7df15]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:02 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIYXvNwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23638306137613838', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638306137613838', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'flavor' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:40:03 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:03 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:40:03 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:03 user nova-compute[71026]:   <serial>f88146f5-694b-4d28-89d3-856adfadc558</serial>
Jul 27 16:40:03 user nova-compute[71026]: </disk>
Jul 27 16:40:03 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No BDM found with device name hda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] No VIF found with MAC fa:16:3e:41:55:6f, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:40:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1249a974-159b-4d63-8479-f998ab10eca5 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.825s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:05 user nova-compute[71026]: INFO nova.compute.manager [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Detaching volume f88146f5-694b-4d28-89d3-856adfadc558
Jul 27 16:40:05 user nova-compute[71026]: INFO nova.virt.block_device [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Attempting to driver detach volume f88146f5-694b-4d28-89d3-856adfadc558 from mountpoint /dev/vdb
Jul 27 16:40:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Attempting to detach device vdb from instance ae684296-4f58-4329-a78d-0098769a937c from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:40:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:05 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:05 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:40:05 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:05 user nova-compute[71026]:   <serial>f88146f5-694b-4d28-89d3-856adfadc558</serial>
Jul 27 16:40:05 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:40:05 user nova-compute[71026]: </disk>
Jul 27 16:40:05 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully detached device vdb from instance ae684296-4f58-4329-a78d-0098769a937c from the persistent domain config.
Jul 27 16:40:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae684296-4f58-4329-a78d-0098769a937c from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:40:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:05 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:05 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:40:05 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:05 user nova-compute[71026]:   <serial>f88146f5-694b-4d28-89d3-856adfadc558</serial>
Jul 27 16:40:05 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:40:05 user nova-compute[71026]: </disk>
Jul 27 16:40:05 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476006.3305106, ae684296-4f58-4329-a78d-0098769a937c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:40:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully detached device vdb from instance ae684296-4f58-4329-a78d-0098769a937c from the live domain config.
Jul 27 16:40:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIYXvNwO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0debd849-6525-4a85-8494-1d752af5d3dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:40:06 user nova-compute[71026]: No targets found.
Jul 27 16:40:06 user nova-compute[71026]: iSNS:
Jul 27 16:40:06 user nova-compute[71026]: No targets found.
Jul 27 16:40:06 user nova-compute[71026]: STATIC:
Jul 27 16:40:06 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:40:06 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:06 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:06 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558
Jul 27 16:40:06 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:06 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:06 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:40:06 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:06 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:06 user nova-compute[71026]: FIRMWARE:
Jul 27 16:40:06 user nova-compute[71026]: No targets found.
Jul 27 16:40:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:40:06 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:40:06 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd07aa1-265b-4a8b-a36e-4ebd50d1b2d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e0f590-e672-4603-b598-35f61e8cb9e2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 (non-flash)
Jul 27 16:40:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30884755a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd2e95d-a6f5-4a51-9a87-62fc8c8e4f86]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8227d4c8-d6cd-42a8-a874-7e014b013820]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee5d0f8-28e9-492f-a35c-797c832927f1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[628d47f4-e1e6-4f8f-a514-caac20e30cf7]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc30c1f8-b582-47c5-953c-38065ff918e2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c9ab4-1085-48db-aa54-3424e7495086]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260]
Jul 27 16:40:06 user nova-compute[71026]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f88146f5-694b-4d28-89d3-856adfadc558 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[294a85e0-b946-4281-a3ae-493e63642d75]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] <== disconnect_volume: return (317ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:40:07 user nova-compute[71026]: DEBUG nova.objects.instance [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'flavor' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-825e240d-ae88-470c-a496-64e988cc7c52 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.884s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "interface-ae684296-4f58-4329-a78d-0098769a937c-72522f20-2619-421b-a896-7323c0ebc8e0" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "interface-ae684296-4f58-4329-a78d-0098769a937c-72522f20-2619-421b-a896-7323c0ebc8e0" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'flavor' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface> {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface> {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Attempting to detach device tap72522f20-26 from instance ae684296-4f58-4329-a78d-0098769a937c from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] detach device xml: <interface type="ethernet">
Jul 27 16:40:08 user nova-compute[71026]:   <mac address="fa:16:3e:43:27:b6"/>
Jul 27 16:40:08 user nova-compute[71026]:   <model type="virtio"/>
Jul 27 16:40:08 user nova-compute[71026]:   <mtu size="1442"/>
Jul 27 16:40:08 user nova-compute[71026]:   <target dev="tap72522f20-26"/>
Jul 27 16:40:08 user nova-compute[71026]: </interface>
Jul 27 16:40:08 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface> {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface>not found in domain: <domain type='kvm' id='16'>
Jul 27 16:40:08 user nova-compute[71026]:   <name>instance-0000000f</name>
Jul 27 16:40:08 user nova-compute[71026]:   <uuid>ae684296-4f58-4329-a78d-0098769a937c</uuid>
Jul 27 16:40:08 user nova-compute[71026]:   <metadata>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:40:08 user nova-compute[71026]:   <nova:package version="0.0.0"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:name>tempest-device-tagging-server-1264265188</nova:name>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:creationTime>2023-07-27 16:39:53</nova:creationTime>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:flavor name="m1.tiny">
Jul 27 16:40:08 user nova-compute[71026]:     <nova:memory>512</nova:memory>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:disk>1</nova:disk>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:swap>0</nova:swap>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:vcpus>1</nova:vcpus>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:flavor>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:user uuid="79f44fae1caa4caa8a6d885d1d7ed62e">tempest-TaggedAttachmentsTest-10523810-project-member</nova:user>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:project uuid="fed38129c3544646b88ae65cf73b552f">tempest-TaggedAttachmentsTest-10523810</nova:project>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:ports>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:port uuid="64270317-1447-4426-b429-cf1a1f41e6f1">
Jul 27 16:40:08 user nova-compute[71026]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:40:08 user nova-compute[71026]:     </nova:port>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:port uuid="72522f20-2619-421b-a896-7323c0ebc8e0">
Jul 27 16:40:08 user nova-compute[71026]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Jul 27 16:40:08 user nova-compute[71026]:     </nova:port>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:ports>
Jul 27 16:40:08 user nova-compute[71026]: </nova:instance>
Jul 27 16:40:08 user nova-compute[71026]:   </metadata>
Jul 27 16:40:08 user nova-compute[71026]:   <memory unit='KiB'>524288</memory>
Jul 27 16:40:08 user nova-compute[71026]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 16:40:08 user nova-compute[71026]:   <vcpu placement='static'>1</vcpu>
Jul 27 16:40:08 user nova-compute[71026]:   <resource>
Jul 27 16:40:08 user nova-compute[71026]:     <partition>/machine</partition>
Jul 27 16:40:08 user nova-compute[71026]:   </resource>
Jul 27 16:40:08 user nova-compute[71026]:   <sysinfo type='smbios'>
Jul 27 16:40:08 user nova-compute[71026]:     <system>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='version'>0.0.0</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='serial'>ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='uuid'>ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='family'>Virtual Machine</entry>
Jul 27 16:40:08 user nova-compute[71026]:     </system>
Jul 27 16:40:08 user nova-compute[71026]:   </sysinfo>
Jul 27 16:40:08 user nova-compute[71026]:   <os>
Jul 27 16:40:08 user nova-compute[71026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 16:40:08 user nova-compute[71026]:     <boot dev='hd'/>
Jul 27 16:40:08 user nova-compute[71026]:     <smbios mode='sysinfo'/>
Jul 27 16:40:08 user nova-compute[71026]:   </os>
Jul 27 16:40:08 user nova-compute[71026]:   <features>
Jul 27 16:40:08 user nova-compute[71026]:     <acpi/>
Jul 27 16:40:08 user nova-compute[71026]:     <apic/>
Jul 27 16:40:08 user nova-compute[71026]:     <vmcoreinfo state='on'/>
Jul 27 16:40:08 user nova-compute[71026]:   </features>
Jul 27 16:40:08 user nova-compute[71026]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 16:40:08 user nova-compute[71026]:     <model fallback='forbid'>Nehalem</model>
Jul 27 16:40:08 user nova-compute[71026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='vme'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='x2apic'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='hypervisor'/>
Jul 27 16:40:08 user nova-compute[71026]:   </cpu>
Jul 27 16:40:08 user nova-compute[71026]:   <clock offset='utc'>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='hpet' present='no'/>
Jul 27 16:40:08 user nova-compute[71026]:   </clock>
Jul 27 16:40:08 user nova-compute[71026]:   <on_poweroff>destroy</on_poweroff>
Jul 27 16:40:08 user nova-compute[71026]:   <on_reboot>restart</on_reboot>
Jul 27 16:40:08 user nova-compute[71026]:   <on_crash>destroy</on_crash>
Jul 27 16:40:08 user nova-compute[71026]:   <devices>
Jul 27 16:40:08 user nova-compute[71026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 16:40:08 user nova-compute[71026]:     <disk type='file' device='disk'>
Jul 27 16:40:08 user nova-compute[71026]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 16:40:08 user nova-compute[71026]:       <source file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk' index='2'/>
Jul 27 16:40:08 user nova-compute[71026]:       <backingStore type='file' index='3'>
Jul 27 16:40:08 user nova-compute[71026]:         <format type='raw'/>
Jul 27 16:40:08 user nova-compute[71026]:         <source file='/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1'/>
Jul 27 16:40:08 user nova-compute[71026]:         <backingStore/>
Jul 27 16:40:08 user nova-compute[71026]:       </backingStore>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='vda' bus='virtio'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='virtio-disk0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </disk>
Jul 27 16:40:08 user nova-compute[71026]:     <disk type='file' device='cdrom'>
Jul 27 16:40:08 user nova-compute[71026]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 16:40:08 user nova-compute[71026]:       <source file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config' index='1'/>
Jul 27 16:40:08 user nova-compute[71026]:       <backingStore/>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='hda' bus='ide'/>
Jul 27 16:40:08 user nova-compute[71026]:       <readonly/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='ide0-0-0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </disk>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='usb' index='0' model='none'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='usb'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='pci.0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='ide' index='0'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='ide'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <interface type='ethernet'>
Jul 27 16:40:08 user nova-compute[71026]:       <mac address='fa:16:3e:41:55:6f'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='tap64270317-14'/>
Jul 27 16:40:08 user nova-compute[71026]:       <model type='virtio'/>
Jul 27 16:40:08 user nova-compute[71026]:       <mtu size='1442'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='net0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </interface>
Jul 27 16:40:08 user nova-compute[71026]:     <interface type='ethernet'>
Jul 27 16:40:08 user nova-compute[71026]:       <mac address='fa:16:3e:43:27:b6'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='tap72522f20-26'/>
Jul 27 16:40:08 user nova-compute[71026]:       <model type='virtio'/>
Jul 27 16:40:08 user nova-compute[71026]:       <mtu size='1442'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='net1'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </interface>
Jul 27 16:40:08 user nova-compute[71026]:     <serial type='pty'>
Jul 27 16:40:08 user nova-compute[71026]:       <source path='/dev/pts/7'/>
Jul 27 16:40:08 user nova-compute[71026]:       <log file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log' append='off'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target type='isa-serial' port='0'>
Jul 27 16:40:08 user nova-compute[71026]:         <model name='isa-serial'/>
Jul 27 16:40:08 user nova-compute[71026]:       </target>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='serial0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </serial>
Jul 27 16:40:08 user nova-compute[71026]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 16:40:08 user nova-compute[71026]:       <source path='/dev/pts/7'/>
Jul 27 16:40:08 user nova-compute[71026]:       <log file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log' append='off'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target type='serial' port='0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='serial0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </console>
Jul 27 16:40:08 user nova-compute[71026]:     <input type='mouse' bus='ps2'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='input0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </input>
Jul 27 16:40:08 user nova-compute[71026]:     <input type='keyboard' bus='ps2'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='input1'/>
Jul 27 16:40:08 user nova-compute[71026]:     </input>
Jul 27 16:40:08 user nova-compute[71026]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 16:40:08 user nova-compute[71026]:       <listen type='address' address='0.0.0.0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </graphics>
Jul 27 16:40:08 user nova-compute[71026]:     <audio id='1' type='none'/>
Jul 27 16:40:08 user nova-compute[71026]:     <video>
Jul 27 16:40:08 user nova-compute[71026]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='video0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </video>
Jul 27 16:40:08 user nova-compute[71026]:     <memballoon model='virtio'>
Jul 27 16:40:08 user nova-compute[71026]:       <stats period='10'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='balloon0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </memballoon>
Jul 27 16:40:08 user nova-compute[71026]:     <rng model='virtio'>
Jul 27 16:40:08 user nova-compute[71026]:       <backend model='random'>/dev/urandom</backend>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='rng0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </rng>
Jul 27 16:40:08 user nova-compute[71026]:   </devices>
Jul 27 16:40:08 user nova-compute[71026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 16:40:08 user nova-compute[71026]:     <label>libvirt-ae684296-4f58-4329-a78d-0098769a937c</label>
Jul 27 16:40:08 user nova-compute[71026]:     <imagelabel>libvirt-ae684296-4f58-4329-a78d-0098769a937c</imagelabel>
Jul 27 16:40:08 user nova-compute[71026]:   </seclabel>
Jul 27 16:40:08 user nova-compute[71026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 16:40:08 user nova-compute[71026]:     <label>+64055:+108</label>
Jul 27 16:40:08 user nova-compute[71026]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 16:40:08 user nova-compute[71026]:   </seclabel>
Jul 27 16:40:08 user nova-compute[71026]: </domain>
Jul 27 16:40:08 user nova-compute[71026]:  {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 16:40:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully detached device tap72522f20-26 from instance ae684296-4f58-4329-a78d-0098769a937c from the persistent domain config.
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] (1/8): Attempting to detach device tap72522f20-26 with device alias net1 from instance ae684296-4f58-4329-a78d-0098769a937c from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] detach device xml: <interface type="ethernet">
Jul 27 16:40:08 user nova-compute[71026]:   <mac address="fa:16:3e:43:27:b6"/>
Jul 27 16:40:08 user nova-compute[71026]:   <model type="virtio"/>
Jul 27 16:40:08 user nova-compute[71026]:   <mtu size="1442"/>
Jul 27 16:40:08 user nova-compute[71026]:   <target dev="tap72522f20-26"/>
Jul 27 16:40:08 user nova-compute[71026]: </interface>
Jul 27 16:40:08 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476008.457061, ae684296-4f58-4329-a78d-0098769a937c => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Start waiting for the detach event from libvirt for device tap72522f20-26 with device alias net1 for instance ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface> {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:43:27:b6"/><model type="virtio"/><mtu size="1442"/><target dev="tap72522f20-26"/></interface>not found in domain: <domain type='kvm' id='16'>
Jul 27 16:40:08 user nova-compute[71026]:   <name>instance-0000000f</name>
Jul 27 16:40:08 user nova-compute[71026]:   <uuid>ae684296-4f58-4329-a78d-0098769a937c</uuid>
Jul 27 16:40:08 user nova-compute[71026]:   <metadata>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:40:08 user nova-compute[71026]:   <nova:package version="0.0.0"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:name>tempest-device-tagging-server-1264265188</nova:name>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:creationTime>2023-07-27 16:39:53</nova:creationTime>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:flavor name="m1.tiny">
Jul 27 16:40:08 user nova-compute[71026]:     <nova:memory>512</nova:memory>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:disk>1</nova:disk>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:swap>0</nova:swap>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:vcpus>1</nova:vcpus>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:flavor>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:user uuid="79f44fae1caa4caa8a6d885d1d7ed62e">tempest-TaggedAttachmentsTest-10523810-project-member</nova:user>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:project uuid="fed38129c3544646b88ae65cf73b552f">tempest-TaggedAttachmentsTest-10523810</nova:project>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:ports>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:port uuid="64270317-1447-4426-b429-cf1a1f41e6f1">
Jul 27 16:40:08 user nova-compute[71026]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:40:08 user nova-compute[71026]:     </nova:port>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:port uuid="72522f20-2619-421b-a896-7323c0ebc8e0">
Jul 27 16:40:08 user nova-compute[71026]:       <nova:ip type="fixed" address="10.10.10.143" ipVersion="4"/>
Jul 27 16:40:08 user nova-compute[71026]:     </nova:port>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:ports>
Jul 27 16:40:08 user nova-compute[71026]: </nova:instance>
Jul 27 16:40:08 user nova-compute[71026]:   </metadata>
Jul 27 16:40:08 user nova-compute[71026]:   <memory unit='KiB'>524288</memory>
Jul 27 16:40:08 user nova-compute[71026]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 27 16:40:08 user nova-compute[71026]:   <vcpu placement='static'>1</vcpu>
Jul 27 16:40:08 user nova-compute[71026]:   <resource>
Jul 27 16:40:08 user nova-compute[71026]:     <partition>/machine</partition>
Jul 27 16:40:08 user nova-compute[71026]:   </resource>
Jul 27 16:40:08 user nova-compute[71026]:   <sysinfo type='smbios'>
Jul 27 16:40:08 user nova-compute[71026]:     <system>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='product'>OpenStack Nova</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='version'>0.0.0</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='serial'>ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='uuid'>ae684296-4f58-4329-a78d-0098769a937c</entry>
Jul 27 16:40:08 user nova-compute[71026]:       <entry name='family'>Virtual Machine</entry>
Jul 27 16:40:08 user nova-compute[71026]:     </system>
Jul 27 16:40:08 user nova-compute[71026]:   </sysinfo>
Jul 27 16:40:08 user nova-compute[71026]:   <os>
Jul 27 16:40:08 user nova-compute[71026]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 27 16:40:08 user nova-compute[71026]:     <boot dev='hd'/>
Jul 27 16:40:08 user nova-compute[71026]:     <smbios mode='sysinfo'/>
Jul 27 16:40:08 user nova-compute[71026]:   </os>
Jul 27 16:40:08 user nova-compute[71026]:   <features>
Jul 27 16:40:08 user nova-compute[71026]:     <acpi/>
Jul 27 16:40:08 user nova-compute[71026]:     <apic/>
Jul 27 16:40:08 user nova-compute[71026]:     <vmcoreinfo state='on'/>
Jul 27 16:40:08 user nova-compute[71026]:   </features>
Jul 27 16:40:08 user nova-compute[71026]:   <cpu mode='custom' match='exact' check='full'>
Jul 27 16:40:08 user nova-compute[71026]:     <model fallback='forbid'>Nehalem</model>
Jul 27 16:40:08 user nova-compute[71026]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='vme'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='x2apic'/>
Jul 27 16:40:08 user nova-compute[71026]:     <feature policy='require' name='hypervisor'/>
Jul 27 16:40:08 user nova-compute[71026]:   </cpu>
Jul 27 16:40:08 user nova-compute[71026]:   <clock offset='utc'>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='pit' tickpolicy='delay'/>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 27 16:40:08 user nova-compute[71026]:     <timer name='hpet' present='no'/>
Jul 27 16:40:08 user nova-compute[71026]:   </clock>
Jul 27 16:40:08 user nova-compute[71026]:   <on_poweroff>destroy</on_poweroff>
Jul 27 16:40:08 user nova-compute[71026]:   <on_reboot>restart</on_reboot>
Jul 27 16:40:08 user nova-compute[71026]:   <on_crash>destroy</on_crash>
Jul 27 16:40:08 user nova-compute[71026]:   <devices>
Jul 27 16:40:08 user nova-compute[71026]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 27 16:40:08 user nova-compute[71026]:     <disk type='file' device='disk'>
Jul 27 16:40:08 user nova-compute[71026]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 27 16:40:08 user nova-compute[71026]:       <source file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk' index='2'/>
Jul 27 16:40:08 user nova-compute[71026]:       <backingStore type='file' index='3'>
Jul 27 16:40:08 user nova-compute[71026]:         <format type='raw'/>
Jul 27 16:40:08 user nova-compute[71026]:         <source file='/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1'/>
Jul 27 16:40:08 user nova-compute[71026]:         <backingStore/>
Jul 27 16:40:08 user nova-compute[71026]:       </backingStore>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='vda' bus='virtio'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='virtio-disk0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </disk>
Jul 27 16:40:08 user nova-compute[71026]:     <disk type='file' device='cdrom'>
Jul 27 16:40:08 user nova-compute[71026]:       <driver name='qemu' type='raw' cache='none'/>
Jul 27 16:40:08 user nova-compute[71026]:       <source file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk.config' index='1'/>
Jul 27 16:40:08 user nova-compute[71026]:       <backingStore/>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='hda' bus='ide'/>
Jul 27 16:40:08 user nova-compute[71026]:       <readonly/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='ide0-0-0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </disk>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='usb' index='0' model='none'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='usb'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='pci' index='0' model='pci-root'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='pci.0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <controller type='ide' index='0'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='ide'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 27 16:40:08 user nova-compute[71026]:     </controller>
Jul 27 16:40:08 user nova-compute[71026]:     <interface type='ethernet'>
Jul 27 16:40:08 user nova-compute[71026]:       <mac address='fa:16:3e:41:55:6f'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target dev='tap64270317-14'/>
Jul 27 16:40:08 user nova-compute[71026]:       <model type='virtio'/>
Jul 27 16:40:08 user nova-compute[71026]:       <mtu size='1442'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='net0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </interface>
Jul 27 16:40:08 user nova-compute[71026]:     <serial type='pty'>
Jul 27 16:40:08 user nova-compute[71026]:       <source path='/dev/pts/7'/>
Jul 27 16:40:08 user nova-compute[71026]:       <log file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log' append='off'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target type='isa-serial' port='0'>
Jul 27 16:40:08 user nova-compute[71026]:         <model name='isa-serial'/>
Jul 27 16:40:08 user nova-compute[71026]:       </target>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='serial0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </serial>
Jul 27 16:40:08 user nova-compute[71026]:     <console type='pty' tty='/dev/pts/7'>
Jul 27 16:40:08 user nova-compute[71026]:       <source path='/dev/pts/7'/>
Jul 27 16:40:08 user nova-compute[71026]:       <log file='/opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/console.log' append='off'/>
Jul 27 16:40:08 user nova-compute[71026]:       <target type='serial' port='0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='serial0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </console>
Jul 27 16:40:08 user nova-compute[71026]:     <input type='mouse' bus='ps2'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='input0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </input>
Jul 27 16:40:08 user nova-compute[71026]:     <input type='keyboard' bus='ps2'>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='input1'/>
Jul 27 16:40:08 user nova-compute[71026]:     </input>
Jul 27 16:40:08 user nova-compute[71026]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Jul 27 16:40:08 user nova-compute[71026]:       <listen type='address' address='0.0.0.0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </graphics>
Jul 27 16:40:08 user nova-compute[71026]:     <audio id='1' type='none'/>
Jul 27 16:40:08 user nova-compute[71026]:     <video>
Jul 27 16:40:08 user nova-compute[71026]:       <model type='virtio' heads='1' primary='yes'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='video0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </video>
Jul 27 16:40:08 user nova-compute[71026]:     <memballoon model='virtio'>
Jul 27 16:40:08 user nova-compute[71026]:       <stats period='10'/>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='balloon0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </memballoon>
Jul 27 16:40:08 user nova-compute[71026]:     <rng model='virtio'>
Jul 27 16:40:08 user nova-compute[71026]:       <backend model='random'>/dev/urandom</backend>
Jul 27 16:40:08 user nova-compute[71026]:       <alias name='rng0'/>
Jul 27 16:40:08 user nova-compute[71026]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 27 16:40:08 user nova-compute[71026]:     </rng>
Jul 27 16:40:08 user nova-compute[71026]:   </devices>
Jul 27 16:40:08 user nova-compute[71026]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 27 16:40:08 user nova-compute[71026]:     <label>libvirt-ae684296-4f58-4329-a78d-0098769a937c</label>
Jul 27 16:40:08 user nova-compute[71026]:     <imagelabel>libvirt-ae684296-4f58-4329-a78d-0098769a937c</imagelabel>
Jul 27 16:40:08 user nova-compute[71026]:   </seclabel>
Jul 27 16:40:08 user nova-compute[71026]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 27 16:40:08 user nova-compute[71026]:     <label>+64055:+108</label>
Jul 27 16:40:08 user nova-compute[71026]:     <imagelabel>+64055:+108</imagelabel>
Jul 27 16:40:08 user nova-compute[71026]:   </seclabel>
Jul 27 16:40:08 user nova-compute[71026]: </domain>
Jul 27 16:40:08 user nova-compute[71026]:  {{(pid=71026) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 27 16:40:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully detached device tap72522f20-26 from instance ae684296-4f58-4329-a78d-0098769a937c from the live domain config.
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "72522f20-2619-421b-a896-7323c0ebc8e0", "address": "fa:16:3e:43:27:b6", "network": {"id": "187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-723267407", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72522f20-26", "ovs_interfaceid": "72522f20-2619-421b-a896-7323c0ebc8e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG os_vif [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72522f20-26, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:08 user nova-compute[71026]: INFO os_vif [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:b6,bridge_name='br-int',has_traffic_filtering=True,id=72522f20-2619-421b-a896-7323c0ebc8e0,network=Network(187a9963-e0e1-4f0e-a0f9-ecaf866aa2e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72522f20-26')
Jul 27 16:40:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:40:08 user nova-compute[71026]:   <nova:package version="0.0.0"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:name>tempest-device-tagging-server-1264265188</nova:name>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:creationTime>2023-07-27 16:40:08</nova:creationTime>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:flavor name="m1.tiny">
Jul 27 16:40:08 user nova-compute[71026]:     <nova:memory>512</nova:memory>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:disk>1</nova:disk>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:swap>0</nova:swap>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:vcpus>1</nova:vcpus>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:flavor>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:user uuid="79f44fae1caa4caa8a6d885d1d7ed62e">tempest-TaggedAttachmentsTest-10523810-project-member</nova:user>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:project uuid="fed38129c3544646b88ae65cf73b552f">tempest-TaggedAttachmentsTest-10523810</nova:project>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:owner>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:40:08 user nova-compute[71026]:   <nova:ports>
Jul 27 16:40:08 user nova-compute[71026]:     <nova:port uuid="64270317-1447-4426-b429-cf1a1f41e6f1">
Jul 27 16:40:08 user nova-compute[71026]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:40:08 user nova-compute[71026]:     </nova:port>
Jul 27 16:40:08 user nova-compute[71026]:   </nova:ports>
Jul 27 16:40:08 user nova-compute[71026]: </nova:instance>
Jul 27 16:40:08 user nova-compute[71026]:  {{(pid=71026) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-unplugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-unplugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:09 user nova-compute[71026]: WARNING nova.compute.manager [req-8aacb251-94f6-4a8d-a3a0-b67644919474 req-29309fe3-7b51-4624-9985-96bbe3b9275d service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-unplugged-72522f20-2619-421b-a896-7323c0ebc8e0 for instance with vm_state active and task_state None.
Jul 27 16:40:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquired lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:40:09 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690475994.7964416, 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:09 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] VM Stopped (Lifecycle Event)
Jul 27 16:40:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-deaca360-1127-4ea6-8ab1-e8f65fb3ed32 None None] [instance: 3a3e38a4-3ef2-4fa7-bb5a-f25f3cc0316d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:10 user nova-compute[71026]: INFO nova.network.neutron [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Port 72522f20-2619-421b-a896-7323c0ebc8e0 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 27 16:40:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [{"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Releasing lock "refresh_cache-ae684296-4f58-4329-a78d-0098769a937c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1cbfcfa0-0ab1-4173-8b4e-aa851a73215f tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "interface-ae684296-4f58-4329-a78d-0098769a937c-72522f20-2619-421b-a896-7323c0ebc8e0" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.084s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:11 user nova-compute[71026]: WARNING nova.compute.manager [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-72522f20-2619-421b-a896-7323c0ebc8e0 for instance with vm_state active and task_state None.
Jul 27 16:40:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-51d47076-1725-4acd-acbd-bf05a6f9f68a req-08beb53e-7409-4314-8357-86db88507624 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-deleted-72522f20-2619-421b-a896-7323c0ebc8e0 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:12 user nova-compute[71026]: INFO nova.compute.manager [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Unrescuing
Jul 27 16:40:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:40:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'flavor' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:13 user nova-compute[71026]: WARNING nova.compute.manager [req-5de370c2-7606-4c34-a9ca-263881a82a34 req-424eb7de-7ac0-47f1-8c57-cfca13ef76e8 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance destroyed successfully.
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing instance network info cache due to event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.network.neutron [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.network.neutron [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updated VIF entry in instance network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG nova.network.neutron [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-380974c9-ebcc-4ac0-95f0-d807f8f4c8a3 req-55f0bb71-b456-435e-b1d5-b095ce4e4239 service nova] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:15 user nova-compute[71026]: WARNING nova.compute.manager [req-52522dc0-9b6e-4101-a35c-7a4ad62165b1 req-14f2d847-45db-4296-a949-46a2a2949ce4 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:40:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing instance network info cache due to event network-changed-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] Acquiring lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] Acquired lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.network.neutron [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Refreshing network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.network.neutron [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updated VIF entry in instance network info cache for port 4e3e2fd1-45b3-46ee-85e8-0692ac6994ee. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG nova.network.neutron [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [{"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bde58a1a-78aa-4000-b4da-24c77260bfbf req-90fe75fb-099e-48dc-9237-f1fe45faf305 service nova] Releasing lock "refresh_cache-1015a1e1-69ee-42a0-acf9-597323751110" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:17 user nova-compute[71026]: WARNING nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:17 user nova-compute[71026]: WARNING nova.compute.manager [req-2e4385c9-943f-4fe2-91b3-7e2460f2c095 req-1c87b5c0-6e0a-46fd-9e66-ec9b85eb7851 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 1015a1e1-69ee-42a0-acf9-597323751110 due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476017.5783722, 1015a1e1-69ee-42a0-acf9-597323751110 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Resumed (Lifecycle Event)
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a7ee5c83-699d-44ec-b187-bb5f0d85b39d tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:40:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476017.5820441, 1015a1e1-69ee-42a0-acf9-597323751110 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Started (Lifecycle Event)
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:40:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.57965850830078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Applying migration context for instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 as it has an incoming, in-progress migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2. Migration status is reverting {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 16:40:20 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating resource usage from migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8243a940-bb67-45c5-ad47-4364a23b5cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance ae684296-4f58-4329-a78d-0098769a937c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc540607-05a8-4a2f-b949-6ddb89eb821d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Port dbd736b7-dabf-4687-845b-afd30024718d binding to destination host user is already ACTIVE {{(pid=71026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Creating tmpfile /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/tmpmg4h748k to verify with other compute node that the instance is on the same shared storage. {{(pid=71026) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:21 user nova-compute[71026]: INFO nova.compute.manager [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attaching volume a7b4de4a-94ad-4b45-af99-c361a55d843d to /dev/vdb
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG os_brick.utils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab8e62-9ec8-4840-9422-582d003f1774]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1653c5f0-ef52-4a92-8a33-68f7893023dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.089s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ef0a2-a507-4b69-8412-040783e3fb4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81659a1e-9f4b-44a0-8712-6ab332a72e0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:40:22 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93024fd5-2d53-4d73-884e-aeaf40e8a966]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== get_connector_properties: return (226ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating existing volume attachment record: 952835e5-6ba7-4d8f-bad0-599d4c882021 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:22 user nova-compute[71026]: WARNING nova.compute.manager [req-bee7d273-3538-4d50-abec-15225dba8b83 req-4449fe83-866c-45cf-9f76-c1db8642d51d service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state resized and task_state resize_reverting.
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance destroyed successfully.
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'resources' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd736b7-da, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:22 user nova-compute[71026]: INFO os_vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:22 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927f6fd-511b-4b07-bc6a-846360bb9658]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:40:22 user nova-compute[71026]: No targets found.
Jul 27 16:40:22 user nova-compute[71026]: iSNS:
Jul 27 16:40:22 user nova-compute[71026]: No targets found.
Jul 27 16:40:22 user nova-compute[71026]: STATIC:
Jul 27 16:40:22 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:40:22 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:22 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:22 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:40:22 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:22 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:22 user nova-compute[71026]: FIRMWARE:
Jul 27 16:40:22 user nova-compute[71026]: No targets found.
Jul 27 16:40:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:40:22 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:40:22 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4df4d7-a540-47de-8f6c-3c1a2f9557ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68db7e-ef91-4d1e-9fb3-e6d91fcd7e12]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:22 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:22 user nova-compute[71026]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30883ad870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73585db7-a577-46ab-a9ec-9fcd6f3ae730]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7566785b-d6e1-4413-ae1e-23a92e1de154]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8add77c2-101f-445e-98cc-a2137a81fcd8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839502f-7e07-4e2e-8bd5-e8526484e8d1]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd868e6-8cf8-46f6-9cb3-a6c5749da71e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f197ff6-c7cd-452e-b174-4dd9506d2c64]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:40:23 user nova-compute[71026]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:23 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2f1901-705c-4cd5-963d-3a9c1cf3c348]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== disconnect_volume: return (348ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:40:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'migration_context' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:24 user nova-compute[71026]: WARNING nova.compute.manager [req-1ae6cc81-9e12-430d-918b-8b971dc5c00a req-3369ad32-c209-4fb4-bdb1-19a7eca027b7 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state resized and task_state resize_reverting.
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:40:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.609s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:24 user nova-compute[71026]: INFO nova.compute.manager [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Swapping old allocation on dict_keys(['df003a51-b9f8-417e-bcc9-71861af955a8']) held by migration 44821232-9ae2-4a5b-aa5e-4271e454bbd2 for instance
Jul 27 16:40:24 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Overwriting current allocation {'allocations': {'df003a51-b9f8-417e-bcc9-71861af955a8': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'ff31b3d25a99410aab34dff6c445ff44', 'user_id': '145d143ed66e4ddd9708b36e6ddeeb09', 'consumer_generation': 1} on consumer 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquired lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Releasing lock "refresh_cache-790cd259-4d88-427a-acf4-d4d70c9fc8d1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG os_brick.utils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18015fff-514f-4649-9517-c399de813bab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb30ba-50cb-4e0c-948b-5af13b75e761]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda1ca8-9c6e-4065-9a5f-9d03f1a86bbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde57fc9-aefc-4ae7-b800-f994be208bd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:40:26 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:40:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d05f938-d59e-43c5-8b33-959ffb22637c]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:40:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTyBxEeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:29 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:29 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:29 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5cf80-9bc0-4ddb-afcb-d444d66b428a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:40:29 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[50826cd6-5c73-4eb6-b0a6-396f0a554f2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d] added
Jul 27 16:40:29 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a26b38-7f2c-45b9-adea-22c77743b0bd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f724b-dd62-40d7-a12b-a559aee2aee7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTyBxEeg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTyBxEeg" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334a1d6-f6cb-4df5-baa5-7c25650cdc7d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTyBxEeg'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46a865-ab15-4914-b14d-b30e54e54965]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d47bf6e-e8a7-436d-842a-718cbcd6daa9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:29 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:29 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:29 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24c858-969f-40d1-8324-78884d69b83c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260]
Jul 27 16:40:30 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a46f6f-f7c5-46a7-bbb4-76dfbeb1b639]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec540e4-adde-407d-a4bf-ae2b2ce9e68f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:30 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:30 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4004e-8e71-472d-9105-bfdd125816da]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:40:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTyBxEeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23435326630663932', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326630663932', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:40:31 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:31 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:40:31 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:31 user nova-compute[71026]:   <serial>a7b4de4a-94ad-4b45-af99-c361a55d843d</serial>
Jul 27 16:40:31 user nova-compute[71026]: </disk>
Jul 27 16:40:31 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No VIF found with MAC fa:16:3e:70:6e:3a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:40:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cad2457b-f5b3-4648-b288-bb0f1bb96ab2 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.950s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Starting finish_revert_migration {{(pid=71026) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 27 16:40:33 user nova-compute[71026]: INFO nova.compute.manager [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Detaching volume a7b4de4a-94ad-4b45-af99-c361a55d843d
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start _get_guest_xml network_info=[{"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0dbf9704-d5fc-432f-bf17-46a573c12c9b', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '790cd259-4d88-427a-acf4-d4d70c9fc8d1', 'attached_at': '2023-07-27T16:40:33.000000', 'detached_at': '', 'volume_id': '9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'serial': '9d46bf45-57e8-4cdb-bebe-11c2f0dec979'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:40:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:40:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'vcpu_model' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:33 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:33 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:33 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:40:33 user nova-compute[71026]: INFO nova.virt.block_device [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attempting to driver detach volume a7b4de4a-94ad-4b45-af99-c361a55d843d from mountpoint /dev/vdb
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Attempting to detach device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:33 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:40:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:33 user nova-compute[71026]:   <serial>a7b4de4a-94ad-4b45-af99-c361a55d843d</serial>
Jul 27 16:40:33 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:40:33 user nova-compute[71026]: </disk>
Jul 27 16:40:33 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd83538-fd9f-4559-8e0a-f1e78798dc4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:40:33 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config.
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:33 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:40:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:33 user nova-compute[71026]:   <serial>a7b4de4a-94ad-4b45-af99-c361a55d843d</serial>
Jul 27 16:40:33 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:40:33 user nova-compute[71026]: </disk>
Jul 27 16:40:33 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b2e9fc-81d8-4459-807f-4a757ad0f9cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979] added
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a16675-7d57-47ee-bd02-f1aba625196e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[995cdf01-b0f3-4de5-b8fe-c7ac2cda02a4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ECbozTuR" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c87851-b953-4716-96af-46fcc375ddb0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ECbozTuR'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b126f-2959-40ad-ad25-8bd738441646]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf67480-6ecb-449a-8053-3ed84c90126c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84624f0c-3bd3-41c2-823c-ced2e13be897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:40:33 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[255746eb-901c-413b-94ea-b43b49613f5f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce22930-288c-4659-ae79-f7035885288a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:33 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:40:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c854ab99-5b69-4f1d-a601-11844755470b]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476034.2150269, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:40:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config.
Jul 27 16:40:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:40:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTyBxEeg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432636532303862', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.802s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:40:35 user nova-compute[71026]:   <uuid>790cd259-4d88-427a-acf4-d4d70c9fc8d1</uuid>
Jul 27 16:40:35 user nova-compute[71026]:   <name>instance-00000006</name>
Jul 27 16:40:35 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:40:35 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:40:35 user nova-compute[71026]:   <metadata>
Jul 27 16:40:35 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:40:35 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherB-server-1556874473</nova:name>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:40:33</nova:creationTime>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:40:35 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:40:35 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:owner>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:user uuid="145d143ed66e4ddd9708b36e6ddeeb09">tempest-ServerActionsTestOtherB-496611114-project-member</nova:user>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:project uuid="ff31b3d25a99410aab34dff6c445ff44">tempest-ServerActionsTestOtherB-496611114</nova:project>
Jul 27 16:40:35 user nova-compute[71026]:       </nova:owner>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:40:35 user nova-compute[71026]:       <nova:ports>
Jul 27 16:40:35 user nova-compute[71026]:         <nova:port uuid="dbd736b7-dabf-4687-845b-afd30024718d">
Jul 27 16:40:35 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:40:35 user nova-compute[71026]:         </nova:port>
Jul 27 16:40:35 user nova-compute[71026]:       </nova:ports>
Jul 27 16:40:35 user nova-compute[71026]:     </nova:instance>
Jul 27 16:40:35 user nova-compute[71026]:   </metadata>
Jul 27 16:40:35 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:40:35 user nova-compute[71026]:     <system>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="serial">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="uuid">790cd259-4d88-427a-acf4-d4d70c9fc8d1</entry>
Jul 27 16:40:35 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:40:35 user nova-compute[71026]:     </system>
Jul 27 16:40:35 user nova-compute[71026]:   </sysinfo>
Jul 27 16:40:35 user nova-compute[71026]:   <os>
Jul 27 16:40:35 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:40:35 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:40:35 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:40:35 user nova-compute[71026]:   </os>
Jul 27 16:40:35 user nova-compute[71026]:   <features>
Jul 27 16:40:35 user nova-compute[71026]:     <acpi/>
Jul 27 16:40:35 user nova-compute[71026]:     <apic/>
Jul 27 16:40:35 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:40:35 user nova-compute[71026]:   </features>
Jul 27 16:40:35 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:40:35 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:40:35 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:40:35 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:40:35 user nova-compute[71026]:   </clock>
Jul 27 16:40:35 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:40:35 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:40:35 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:40:35 user nova-compute[71026]:   </cpu>
Jul 27 16:40:35 user nova-compute[71026]:   <devices>
Jul 27 16:40:35 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:40:35 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:40:35 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk"/>
Jul 27 16:40:35 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:40:35 user nova-compute[71026]:     </disk>
Jul 27 16:40:35 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:40:35 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:35 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:40:35 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:40:35 user nova-compute[71026]:       <serial>9d46bf45-57e8-4cdb-bebe-11c2f0dec979</serial>
Jul 27 16:40:35 user nova-compute[71026]:     </disk>
Jul 27 16:40:35 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:40:35 user nova-compute[71026]:       <mac address="fa:16:3e:cb:e0:30"/>
Jul 27 16:40:35 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:40:35 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:40:35 user nova-compute[71026]:       <target dev="tapdbd736b7-da"/>
Jul 27 16:40:35 user nova-compute[71026]:     </interface>
Jul 27 16:40:35 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:40:35 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/console.log" append="off"/>
Jul 27 16:40:35 user nova-compute[71026]:     </serial>
Jul 27 16:40:35 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:40:35 user nova-compute[71026]:     <video>
Jul 27 16:40:35 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:40:35 user nova-compute[71026]:     </video>
Jul 27 16:40:35 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:40:35 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:40:35 user nova-compute[71026]:     </rng>
Jul 27 16:40:35 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:40:35 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:40:35 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:40:35 user nova-compute[71026]:     </memballoon>
Jul 27 16:40:35 user nova-compute[71026]:   </devices>
Jul 27 16:40:35 user nova-compute[71026]: </domain>
Jul 27 16:40:35 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1518d-3cfb-443f-a2f5-74b377546015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:40:35 user nova-compute[71026]: No targets found.
Jul 27 16:40:35 user nova-compute[71026]: iSNS:
Jul 27 16:40:35 user nova-compute[71026]: No targets found.
Jul 27 16:40:35 user nova-compute[71026]: STATIC:
Jul 27 16:40:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:40:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:40:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d
Jul 27 16:40:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:35 user nova-compute[71026]: FIRMWARE:
Jul 27 16:40:35 user nova-compute[71026]: No targets found.
Jul 27 16:40:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:40:35 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:40:35 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbd736b7-da, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbd736b7-da, col_values=(('external_ids', {'iface-id': 'dbd736b7-dabf-4687-845b-afd30024718d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e0:30', 'vm-uuid': '790cd259-4d88-427a-acf4-d4d70c9fc8d1'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:35 user nova-compute[71026]: INFO os_vif [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[736509b0-7041-4a9f-ab0c-aa021a1d986e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58563817-e2bb-4b11-9be0-2299b122d6cf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:35 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:35 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:35 user nova-compute[71026]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d (non-flash)
Jul 27 16:40:35 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308868dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff2e3bc-ab00-457f-b736-45c89a6eca9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df1f718-8568-45dc-bac9-76ae15fb2928]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408c7df-c1da-4e53-b428-d0b966f6254d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1576899a-1086-4bdc-91b9-662312e10a2f]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ee4749-29da-4e28-bd0d-57981506cd16]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a47a3b-82d7-4694-aebf-6bc5fdd10a37]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260]
Jul 27 16:40:35 user nova-compute[71026]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7b4de4a-94ad-4b45-af99-c361a55d843d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2418e1e9-45e7-4b8f-bed0-205973dad3da]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== disconnect_volume: return (1131ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d9ab585e-3a65-44fb-b7d1-802b6effc9a5 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.627s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:36 user nova-compute[71026]: WARNING nova.compute.manager [req-a0ecd9be-b1a9-4917-9aa7-ac13e596d2c3 req-49f422d4-bc77-484e-8da6-416dd2fe77fa service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state resized and task_state resize_reverting.
Jul 27 16:40:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:37 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476022.6522965, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:37 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Stopped (Lifecycle Event)
Jul 27 16:40:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7410210c-2ded-47d8-889f-63b6553e58ac None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:38 user nova-compute[71026]: WARNING nova.compute.manager [req-da0adf39-cc84-4746-82dc-086230385b13 req-138f4795-cdad-4c34-af57-a7ccbdaa76a1 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state resized and task_state resize_reverting.
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476038.8505535, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:38 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Resumed (Lifecycle Event)
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:40:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance running successfully.
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] finish_revert_migration finished successfully. {{(pid=71026) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:40:38 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476038.8514178, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:40:38 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Started (Lifecycle Event)
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:40:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:40:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 27 16:40:39 user nova-compute[71026]: INFO nova.compute.manager [None req-20f15383-db33-42ff-bf64-213e27fd1847 tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance to original state: 'active'
Jul 27 16:40:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:46 user nova-compute[71026]: INFO nova.compute.manager [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Detaching volume 3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:40:46 user nova-compute[71026]: INFO nova.virt.block_device [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Attempting to driver detach volume 3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 from mountpoint /dev/vdb
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Attempting to detach device vdb from instance 1015a1e1-69ee-42a0-acf9-597323751110 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:46 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:46 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:40:46 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:46 user nova-compute[71026]:   <serial>3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9</serial>
Jul 27 16:40:46 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:40:46 user nova-compute[71026]: </disk>
Jul 27 16:40:46 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Successfully detached device vdb from instance 1015a1e1-69ee-42a0-acf9-597323751110 from the persistent domain config.
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1015a1e1-69ee-42a0-acf9-597323751110 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:40:46 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:40:46 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:40:46 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:40:46 user nova-compute[71026]:   <serial>3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9</serial>
Jul 27 16:40:46 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:40:46 user nova-compute[71026]: </disk>
Jul 27 16:40:46 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476046.7425537, 1015a1e1-69ee-42a0-acf9-597323751110 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:40:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Successfully detached device vdb from instance 1015a1e1-69ee-42a0-acf9-597323751110 from the live domain config.
Jul 27 16:40:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wYSOsuKg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:40:46 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1258ae2b-0bcd-4127-aa1b-b5b511e91645]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:40:46 user nova-compute[71026]: No targets found.
Jul 27 16:40:46 user nova-compute[71026]: iSNS:
Jul 27 16:40:46 user nova-compute[71026]: No targets found.
Jul 27 16:40:46 user nova-compute[71026]: STATIC:
Jul 27 16:40:46 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:40:46 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:46 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:46 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9
Jul 27 16:40:46 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:40:46 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:40:46 user nova-compute[71026]: FIRMWARE:
Jul 27 16:40:46 user nova-compute[71026]: No targets found.
Jul 27 16:40:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:40:46 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:40:46 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28521b5b-2129-465c-9e01-f49e99855662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26881362-7174-4143-8f35-fa47924712d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:46 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 (non-flash)
Jul 27 16:40:46 user nova-compute[71026]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:40:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308867ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a544d7-2ee5-4cba-8278-d510afa7768f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed4cc0-787f-4985-9571-1966e283483d]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca8e44-ba78-4f6f-acfb-502b32248806]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dbb77f-8d0a-4fd6-a95b-d2a964cf40a2]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc99439-5daa-4845-ab9b-5c8afc20ca4a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df39257-36c1-4cc5-8825-4f1e9874234d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260]
Jul 27 16:40:47 user nova-compute[71026]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9, portal: 172.16.0.220,3260] successful.
Jul 27 16:40:47 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b94d21d-5c1e-44d5-8ba1-1db83ccf08a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505834c-c661-4d5c-8bc7-1fe04188e0ac]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] <== disconnect_volume: return (370ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:40:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'flavor' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdc91c9a-4688-4d18-8d22-b4e5103a7fa9 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:51 user nova-compute[71026]: INFO nova.compute.manager [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Terminating instance
Jul 27 16:40:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-d65bb9e2-ca71-4fa1-b6c7-de468fed2bad req-d575b0aa-6f31-4605-b5ef-fd584a1b25a0 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Instance destroyed successfully.
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.objects.instance [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lazy-loading 'resources' on Instance uuid 8243a940-bb67-45c5-ad47-4364a23b5cd9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1716838670',display_name='tempest-VolumesAdminNegativeTest-server-1716838670',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1716838670',id=8,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlTDVCVoCt5B486g5pFKW5EWWT2ZDWv+y4etA98Z8C1CMlR++fUPxNKKFKEaPI0H/+S9MBRAtEB1Qvj8dSykNUpMktTnUoaveSAL5fyeE52dGFXKeEPx4Q2ldNePxv4Eg==',key_name='tempest-keypair-312622122',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c84998d34fb49cb9cb17eb2b4353201',ramdisk_id='',reservation_id='r-d4oun64m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1182056978',owner_user_name='tempest-VolumesAdminNegativeTest-1182056978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:35:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789e9b39aef14ae4af5a48148b92994d',uuid=8243a940-bb67-45c5-ad47-4364a23b5cd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converting VIF {"id": "d6ecd5de-a988-469b-b180-682819d64f45", "address": "fa:16:3e:16:be:b4", "network": {"id": "653bfc70-8c37-4157-a5c1-a007606d16e0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-426752438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c84998d34fb49cb9cb17eb2b4353201", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ecd5de-a9", "ovs_interfaceid": "d6ecd5de-a988-469b-b180-682819d64f45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG os_vif [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ecd5de-a9, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:52 user nova-compute[71026]: INFO os_vif [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:be:b4,bridge_name='br-int',has_traffic_filtering=True,id=d6ecd5de-a988-469b-b180-682819d64f45,network=Network(653bfc70-8c37-4157-a5c1-a007606d16e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ecd5de-a9')
Jul 27 16:40:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Deleting instance files /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9_del
Jul 27 16:40:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Deletion of /opt/stack/data/nova/instances/8243a940-bb67-45c5-ad47-4364a23b5cd9_del complete
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: INFO nova.compute.manager [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 27 16:40:52 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:54 user nova-compute[71026]: WARNING nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state active and task_state deleting.
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:54 user nova-compute[71026]: WARNING nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state active and task_state deleting.
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:54 user nova-compute[71026]: WARNING nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state active and task_state deleting.
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4184389-9f84-4b62-949f-dc5ab2bcf122 req-80cb8a2d-f693-4979-8c02-cc512c4139cb service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-unplugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:54 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Took 2.56 seconds to deallocate network for instance.
Jul 27 16:40:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-d9360b08-e7f5-4705-a93c-ffb199d77551 req-2ad63c1f-38a4-4871-a2a2-566ea232bc3c service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-deleted-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:40:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.676s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:55 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Deleted allocations for instance 8243a940-bb67-45c5-ad47-4364a23b5cd9
Jul 27 16:40:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-20b7f38c-12b8-43dc-90cd-0545cbd9887f tempest-VolumesAdminNegativeTest-1182056978 tempest-VolumesAdminNegativeTest-1182056978-project-member] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.475s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] Acquiring lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] Lock "8243a940-bb67-45c5-ad47-4364a23b5cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] No waiting events found dispatching network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:56 user nova-compute[71026]: WARNING nova.compute.manager [req-2326ea06-107b-4540-a745-a6a03b935dc2 req-669e57c1-a83f-4ebc-bdaf-1d1541c6d5f3 service nova] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Received unexpected event network-vif-plugged-d6ecd5de-a988-469b-b180-682819d64f45 for instance with vm_state deleted and task_state None.
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:56 user nova-compute[71026]: INFO nova.compute.manager [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Terminating instance
Jul 27 16:40:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Instance destroyed successfully.
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lazy-loading 'resources' on Instance uuid bc540607-05a8-4a2f-b949-6ddb89eb821d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:38:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1959557686',display_name='tempest-VolumesActionsTest-instance-1959557686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1959557686',id=16,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db945827a65a468eab6ebd4660b0d73c',ramdisk_id='',reservation_id='r-kl7poj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-626397135',owner_user_name='tempest-VolumesActionsTest-626397135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:39:05Z,user_data=None,user_id='d5dcb248d3f3459d88d03dc648b5d9a8',uuid=bc540607-05a8-4a2f-b949-6ddb89eb821d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converting VIF {"id": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "address": "fa:16:3e:e0:2f:5b", "network": {"id": "43e4891a-b0be-4d1d-835c-b7026b919255", "bridge": "br-int", "label": "tempest-VolumesActionsTest-269908495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db945827a65a468eab6ebd4660b0d73c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap322c9233-ad", "ovs_interfaceid": "322c9233-ad7b-43ac-9c9c-4f402f8bcdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG os_vif [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap322c9233-ad, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:57 user nova-compute[71026]: INFO os_vif [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:2f:5b,bridge_name='br-int',has_traffic_filtering=True,id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3,network=Network(43e4891a-b0be-4d1d-835c-b7026b919255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap322c9233-ad')
Jul 27 16:40:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Deleting instance files /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d_del
Jul 27 16:40:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Deletion of /opt/stack/data/nova/instances/bc540607-05a8-4a2f-b949-6ddb89eb821d_del complete
Jul 27 16:40:57 user nova-compute[71026]: INFO nova.compute.manager [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 27 16:40:57 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:40:57 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:58 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Took 0.59 seconds to deallocate network for instance.
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-0dfaa10e-ba74-4377-b27e-7cf4c3389f34 req-c9bfbc32-8fab-4ccc-ac5c-cee58cfcbcab service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-vif-deleted-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:58 user nova-compute[71026]: INFO nova.compute.manager [req-0dfaa10e-ba74-4377-b27e-7cf4c3389f34 req-c9bfbc32-8fab-4ccc-ac5c-cee58cfcbcab service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Neutron deleted interface 322c9233-ad7b-43ac-9c9c-4f402f8bcdc3; detaching it from the instance and deleting it from the info cache
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-0dfaa10e-ba74-4377-b27e-7cf4c3389f34 req-c9bfbc32-8fab-4ccc-ac5c-cee58cfcbcab service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-0dfaa10e-ba74-4377-b27e-7cf4c3389f34 req-c9bfbc32-8fab-4ccc-ac5c-cee58cfcbcab service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Detach interface failed, port_id=322c9233-ad7b-43ac-9c9c-4f402f8bcdc3, reason: Instance bc540607-05a8-4a2f-b949-6ddb89eb821d could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-vif-unplugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] No waiting events found dispatching network-vif-unplugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:58 user nova-compute[71026]: WARNING nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received unexpected event network-vif-unplugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 for instance with vm_state deleted and task_state None.
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Acquiring lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] No waiting events found dispatching network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:40:58 user nova-compute[71026]: WARNING nova.compute.manager [req-b75025ca-a7e8-43c1-b8c0-9c1c1e5bf6d0 req-796dbf00-3838-4e50-9f33-a17128b5c1fc service nova] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Received unexpected event network-vif-plugged-322c9233-ad7b-43ac-9c9c-4f402f8bcdc3 for instance with vm_state deleted and task_state None.
Jul 27 16:40:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:58 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Deleted allocations for instance bc540607-05a8-4a2f-b949-6ddb89eb821d
Jul 27 16:40:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-361aad96-04a3-483c-952c-21bd1debd361 tempest-VolumesActionsTest-626397135 tempest-VolumesActionsTest-626397135-project-member] Lock "bc540607-05a8-4a2f-b949-6ddb89eb821d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:40:59 user nova-compute[71026]: INFO nova.compute.manager [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Terminating instance
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] Instance destroyed successfully.
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.objects.instance [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lazy-loading 'resources' on Instance uuid ae684296-4f58-4329-a78d-0098769a937c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-27T16:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1264265188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1264265188',id=15,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBzr/8PCNRQsiiZPhlzFFp5PqbSwtaERHWuWkN6b7MyLBFbTZU+5hAaV3pXyH8kWjw4eO0FZ21PQywdXtw5g4JbKm8VFE2iGvYZ3hTx+KkTT5lJ5ahuWCna4kuZ/CM4mQ==',key_name='tempest-keypair-951214916',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fed38129c3544646b88ae65cf73b552f',ramdisk_id='',reservation_id='r-005b2fve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-10523810',owner_user_name='tempest-TaggedAttachmentsTest-10523810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='79f44fae1caa4caa8a6d885d1d7ed62e',uuid=ae684296-4f58-4329-a78d-0098769a937c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converting VIF {"id": "64270317-1447-4426-b429-cf1a1f41e6f1", "address": "fa:16:3e:41:55:6f", "network": {"id": "fe9c8c30-3e0a-4afe-a188-cfac0850eb6d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-164947645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fed38129c3544646b88ae65cf73b552f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64270317-14", "ovs_interfaceid": "64270317-1447-4426-b429-cf1a1f41e6f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG os_vif [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64270317-14, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:40:59 user nova-compute[71026]: INFO os_vif [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:55:6f,bridge_name='br-int',has_traffic_filtering=True,id=64270317-1447-4426-b429-cf1a1f41e6f1,network=Network(fe9c8c30-3e0a-4afe-a188-cfac0850eb6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64270317-14')
Jul 27 16:40:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Deleting instance files /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c_del
Jul 27 16:40:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Deletion of /opt/stack/data/nova/instances/ae684296-4f58-4329-a78d-0098769a937c_del complete
Jul 27 16:40:59 user nova-compute[71026]: INFO nova.compute.manager [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] [instance: ae684296-4f58-4329-a78d-0098769a937c] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 27 16:40:59 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:40:59 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-unplugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-unplugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-unplugged-64270317-1447-4426-b429-cf1a1f41e6f1 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Acquiring lock "ae684296-4f58-4329-a78d-0098769a937c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] Lock "ae684296-4f58-4329-a78d-0098769a937c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] No waiting events found dispatching network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:00 user nova-compute[71026]: WARNING nova.compute.manager [req-b71e10d2-fc92-4286-8678-48e8f3a8165c req-16b0fd4f-ff6d-494c-9e11-efc4edf8a7b3 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received unexpected event network-vif-plugged-64270317-1447-4426-b429-cf1a1f41e6f1 for instance with vm_state active and task_state deleting.
Jul 27 16:41:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:01 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:01 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] Took 1.76 seconds to deallocate network for instance.
Jul 27 16:41:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-a5a4ff4c-ec50-4c4c-bc3d-817916ed633d req-f70281c3-00bb-4e02-b152-e7cacbd9b2c4 service nova] [instance: ae684296-4f58-4329-a78d-0098769a937c] Received event network-vif-deleted-64270317-1447-4426-b429-cf1a1f41e6f1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:01 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:02 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Deleted allocations for instance ae684296-4f58-4329-a78d-0098769a937c
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-abd8da75-3620-4b2f-96d8-863e9cf1ae56 tempest-TaggedAttachmentsTest-10523810 tempest-TaggedAttachmentsTest-10523810-project-member] Lock "ae684296-4f58-4329-a78d-0098769a937c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.142s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:02 user nova-compute[71026]: INFO nova.compute.manager [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Unrescuing
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-changed-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing instance network info cache due to event network-changed-edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:41:02 user nova-compute[71026]: DEBUG nova.network.neutron [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing network info cache for port edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'flavor' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated VIF entry in instance network info cache for port edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-210e984e-d52c-403c-844e-a60820d11862 req-2153665e-3bbf-41d6-8c94-15f5f8fc9b43 service nova] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance destroyed successfully.
Jul 27 16:41:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:04 user nova-compute[71026]: WARNING nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:41:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:04 user nova-compute[71026]: WARNING nova.compute.manager [req-e406be54-8b23-401c-9e07-c530ebe4e555 req-86242f20-69d0-4c6e-be74-602c7b892fd3 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:41:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 7057a6bb-81b2-42a9-910c-c264a450fa20 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: INFO nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:06 user nova-compute[71026]: WARNING nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:41:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:06 user nova-compute[71026]: WARNING nova.compute.manager [req-9734e142-8a61-4631-8a12-1c149e8e75d7 req-69303e5e-4454-4cab-867b-408120c64bd9 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476052.1053352, 8243a940-bb67-45c5-ad47-4364a23b5cd9 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:07 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] VM Stopped (Lifecycle Event)
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3a53c99b-b3d1-4504-9b13-78dc5ed41cca None None] [instance: 8243a940-bb67-45c5-ad47-4364a23b5cd9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for b991c2a5-894c-49e7-896c-69eb95eb84bd due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476067.1638856, b991c2a5-894c-49e7-896c-69eb95eb84bd => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Resumed (Lifecycle Event)
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7ac65e18-b594-40ed-95f8-acb5f75904b6 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:41:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476067.1657615, b991c2a5-894c-49e7-896c-69eb95eb84bd => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Started (Lifecycle Event)
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:41:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:12 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476057.482722, bc540607-05a8-4a2f-b949-6ddb89eb821d => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:12 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] VM Stopped (Lifecycle Event)
Jul 27 16:41:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e4a381e-d87e-44ae-a491-f46f9525df69 None None] [instance: bc540607-05a8-4a2f-b949-6ddb89eb821d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476059.7886667, ae684296-4f58-4329-a78d-0098769a937c => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:14 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: ae684296-4f58-4329-a78d-0098769a937c] VM Stopped (Lifecycle Event)
Jul 27 16:41:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-37bf4539-5821-4c0c-ba74-1a7a1f6acfbf None None] [instance: ae684296-4f58-4329-a78d-0098769a937c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:41:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.66104507446289GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1015a1e1-69ee-42a0-acf9-597323751110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:41:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:41:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:41:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:30 user nova-compute[71026]: INFO nova.compute.manager [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attaching volume 57f705f9-2906-48b1-9155-5140ee439b20 to /dev/vdb
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.utils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797e61e-ccf1-4c96-9fa8-25925e40879a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79609f8-f95f-433b-82cd-8d908fe45d1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd4b173-ce0c-4a98-96b0-d2c344d44fc9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1aa79-e024-4fb9-9b69-c825176a41b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:41:30 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca906e4b-f8d7-4f9f-8a1f-72e3b4606164]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG os_brick.utils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating existing volume attachment record: 82286fdc-7a81-47bc-84dc-7f2b003626e7 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:41:30 user nova-compute[71026]: INFO nova.compute.claims [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Claim successful on node user
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:41:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.policy [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffab398326e24e2e9f455e7fde6277e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6890027dbc4f5bba2f52e1c6db058d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:41:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Creating image(s)
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "/opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "/opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk 1073741824" returned: 0 in 0.057s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Successfully created port: eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Cannot resize image /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'migration_context' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Ensure instance console log exists: /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Successfully updated port: eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquired lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-changed-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Refreshing instance network info cache due to event network-changed-eccba2a6-423a-428b-a59c-377a2aabcb9b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] Acquiring lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:41:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updating instance_info_cache with network_info: [{"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Releasing lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Instance network_info: |[{"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] Acquired lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Refreshing network info cache for port eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Start _get_guest_xml network_info=[{"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:41:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:41:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6433446',id=18,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJJG+XuxlLUjKQ1XTRZMkyijpcvgHAFW8LCMfnw6CtvJzxMOxsbP15W5ArIVCGSu2IFjSaH1b/H0b4S1y2arpLZJSlBdm3ro2DdDFWb1n5k0o2wxO/XZHqlcXvOvnYN7g==',key_name='tempest-keypair-1443763841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d6890027dbc4f5bba2f52e1c6db058d',ramdisk_id='',reservation_id='r-6t4vxcib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffab398326e24e2e9f455e7fde6277e3',uuid=a5c6cc55-aab2-4594-ba5a-1aef54b50a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converting VIF {"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'pci_devices' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:41:33 user nova-compute[71026]:   <uuid>a5c6cc55-aab2-4594-ba5a-1aef54b50a79</uuid>
Jul 27 16:41:33 user nova-compute[71026]:   <name>instance-00000012</name>
Jul 27 16:41:33 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:41:33 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:41:33 user nova-compute[71026]:   <metadata>
Jul 27 16:41:33 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:41:33 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690</nova:name>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:41:33</nova:creationTime>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:41:33 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:41:33 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:owner>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:user uuid="ffab398326e24e2e9f455e7fde6277e3">tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member</nova:user>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:project uuid="0d6890027dbc4f5bba2f52e1c6db058d">tempest-TestServerVolumeAttachScenarioOldVersion-848109580</nova:project>
Jul 27 16:41:33 user nova-compute[71026]:       </nova:owner>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:41:33 user nova-compute[71026]:       <nova:ports>
Jul 27 16:41:33 user nova-compute[71026]:         <nova:port uuid="eccba2a6-423a-428b-a59c-377a2aabcb9b">
Jul 27 16:41:33 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 16:41:33 user nova-compute[71026]:         </nova:port>
Jul 27 16:41:33 user nova-compute[71026]:       </nova:ports>
Jul 27 16:41:33 user nova-compute[71026]:     </nova:instance>
Jul 27 16:41:33 user nova-compute[71026]:   </metadata>
Jul 27 16:41:33 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:41:33 user nova-compute[71026]:     <system>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="serial">a5c6cc55-aab2-4594-ba5a-1aef54b50a79</entry>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="uuid">a5c6cc55-aab2-4594-ba5a-1aef54b50a79</entry>
Jul 27 16:41:33 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:41:33 user nova-compute[71026]:     </system>
Jul 27 16:41:33 user nova-compute[71026]:   </sysinfo>
Jul 27 16:41:33 user nova-compute[71026]:   <os>
Jul 27 16:41:33 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:41:33 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:41:33 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:41:33 user nova-compute[71026]:   </os>
Jul 27 16:41:33 user nova-compute[71026]:   <features>
Jul 27 16:41:33 user nova-compute[71026]:     <acpi/>
Jul 27 16:41:33 user nova-compute[71026]:     <apic/>
Jul 27 16:41:33 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:41:33 user nova-compute[71026]:   </features>
Jul 27 16:41:33 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:41:33 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:41:33 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:41:33 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:41:33 user nova-compute[71026]:   </clock>
Jul 27 16:41:33 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:41:33 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:41:33 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:41:33 user nova-compute[71026]:   </cpu>
Jul 27 16:41:33 user nova-compute[71026]:   <devices>
Jul 27 16:41:33 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:41:33 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:41:33 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk"/>
Jul 27 16:41:33 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:41:33 user nova-compute[71026]:     </disk>
Jul 27 16:41:33 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:41:33 user nova-compute[71026]:       <mac address="fa:16:3e:45:99:6a"/>
Jul 27 16:41:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:41:33 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:41:33 user nova-compute[71026]:       <target dev="tapeccba2a6-42"/>
Jul 27 16:41:33 user nova-compute[71026]:     </interface>
Jul 27 16:41:33 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:41:33 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/console.log" append="off"/>
Jul 27 16:41:33 user nova-compute[71026]:     </serial>
Jul 27 16:41:33 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:41:33 user nova-compute[71026]:     <video>
Jul 27 16:41:33 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:41:33 user nova-compute[71026]:     </video>
Jul 27 16:41:33 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:41:33 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:41:33 user nova-compute[71026]:     </rng>
Jul 27 16:41:33 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:41:33 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:41:33 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:41:33 user nova-compute[71026]:     </memballoon>
Jul 27 16:41:33 user nova-compute[71026]:   </devices>
Jul 27 16:41:33 user nova-compute[71026]: </domain>
Jul 27 16:41:33 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6433446',id=18,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJJG+XuxlLUjKQ1XTRZMkyijpcvgHAFW8LCMfnw6CtvJzxMOxsbP15W5ArIVCGSu2IFjSaH1b/H0b4S1y2arpLZJSlBdm3ro2DdDFWb1n5k0o2wxO/XZHqlcXvOvnYN7g==',key_name='tempest-keypair-1443763841',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d6890027dbc4f5bba2f52e1c6db058d',ramdisk_id='',reservation_id='r-6t4vxcib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:41:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffab398326e24e2e9f455e7fde6277e3',uuid=a5c6cc55-aab2-4594-ba5a-1aef54b50a79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converting VIF {"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG os_vif [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeccba2a6-42, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeccba2a6-42, col_values=(('external_ids', {'iface-id': 'eccba2a6-423a-428b-a59c-377a2aabcb9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:99:6a', 'vm-uuid': 'a5c6cc55-aab2-4594-ba5a-1aef54b50a79'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:33 user nova-compute[71026]: INFO os_vif [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42')
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] No VIF found with MAC fa:16:3e:45:99:6a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updated VIF entry in instance network info cache for port eccba2a6-423a-428b-a59c-377a2aabcb9b. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updating instance_info_cache with network_info: [{"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dff23060-8f75-4d01-a7c8-3cf0014be4d8 req-e5b418f4-a82b-4635-b673-35826f7bed68 service nova] Releasing lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:41:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] No waiting events found dispatching network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:34 user nova-compute[71026]: WARNING nova.compute.manager [req-32419243-1a62-46c8-a0f8-73bf4affc3f5 req-8e13aeb9-18d0-4f3d-b2cd-8a59892dc0ce service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received unexpected event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b for instance with vm_state building and task_state spawning.
Jul 27 16:41:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476096.6556509, a5c6cc55-aab2-4594-ba5a-1aef54b50a79 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] VM Resumed (Lifecycle Event)
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Instance spawned successfully.
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476096.6662824, a5c6cc55-aab2-4594-ba5a-1aef54b50a79 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] VM Started (Lifecycle Event)
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Took 5.48 seconds to spawn the instance on the hypervisor.
Jul 27 16:41:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:36 user nova-compute[71026]: INFO nova.compute.manager [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Took 6.22 seconds to build instance.
Jul 27 16:41:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4c585695-e8c5-49de-a8ac-29e2a0fabe46 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.342s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] No waiting events found dispatching network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:37 user nova-compute[71026]: WARNING nova.compute.manager [req-b154ba0f-8852-4cb5-808c-8908936fe2b6 req-b709e03f-e331-4721-849a-cbcd80af076c service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received unexpected event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b for instance with vm_state active and task_state None.
Jul 27 16:41:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRALFfQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:41:37 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:41:37 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:41:37 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf72ac94-e6f4-49c2-8282-ae6e07a1166c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:41:37 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a8679d-f877-4f6d-8da4-ca78bdbe9061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20] added
Jul 27 16:41:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d40c14-a45c-4ab8-ad45-30570528f3d7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fdda28-04d6-4111-9925-12000ca1ec27]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRALFfQC {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRALFfQC" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55235e08-67b1-4189-9f53-6ae5bf283401]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRALFfQC'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef4618-7f63-4b6e-a5d0-5d292d7502b6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7364e-6502-49a7-8d29-bb1c342257e6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[434437fc-4a0f-4ab8-9117-d9687da674fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260]
Jul 27 16:41:38 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260] successful.
Jul 27 16:41:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f5eddd-fc9b-47f7-97e1-eab8524c651f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3780ff-c52e-4e91-80cb-09c6490fca10]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)
Jul 27 16:41:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fcfef2-82ab-4e3b-8716-a07393019169]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRALFfQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:41:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23535306637636431', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535306637636431', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.objects.instance [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:41:39 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:41:39 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:41:39 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:41:39 user nova-compute[71026]:   <serial>57f705f9-2906-48b1-9155-5140ee439b20</serial>
Jul 27 16:41:39 user nova-compute[71026]: </disk>
Jul 27 16:41:39 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No VIF found with MAC fa:16:3e:70:6e:3a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:41:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-aa8f711f-c452-42ff-a249-7f399d31595c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.503s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:41 user nova-compute[71026]: INFO nova.compute.manager [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Detaching volume 57f705f9-2906-48b1-9155-5140ee439b20
Jul 27 16:41:41 user nova-compute[71026]: INFO nova.virt.block_device [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attempting to driver detach volume 57f705f9-2906-48b1-9155-5140ee439b20 from mountpoint /dev/vdb
Jul 27 16:41:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Attempting to detach device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:41:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:41:41 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:41:41 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:41:41 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:41:41 user nova-compute[71026]:   <serial>57f705f9-2906-48b1-9155-5140ee439b20</serial>
Jul 27 16:41:41 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:41:41 user nova-compute[71026]: </disk>
Jul 27 16:41:41 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:41:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config.
Jul 27 16:41:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:41:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:41:41 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:41:41 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:41:41 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:41:41 user nova-compute[71026]:   <serial>57f705f9-2906-48b1-9155-5140ee439b20</serial>
Jul 27 16:41:41 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:41:41 user nova-compute[71026]: </disk>
Jul 27 16:41:41 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476102.2600253, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:41:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config.
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRALFfQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:41:42 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce1b5c-4e1d-4790-bf5c-1d85197ce398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:41:42 user nova-compute[71026]: No targets found.
Jul 27 16:41:42 user nova-compute[71026]: iSNS:
Jul 27 16:41:42 user nova-compute[71026]: No targets found.
Jul 27 16:41:42 user nova-compute[71026]: STATIC:
Jul 27 16:41:42 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:41:42 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:41:42 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:41:42 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20
Jul 27 16:41:42 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:41:42 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:41:42 user nova-compute[71026]: FIRMWARE:
Jul 27 16:41:42 user nova-compute[71026]: No targets found.
Jul 27 16:41:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:41:42 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:41:42 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: INFO nova.compute.manager [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Terminating instance
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5f3728-b23c-4287-93b0-453b1c869c58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce79e2-80a2-4952-9500-43eb3001c2f3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:42 user nova-compute[71026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)
Jul 27 16:41:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:41:42 user nova-compute[71026]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 (non-flash)
Jul 27 16:41:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308867a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[592298a0-f0c4-421a-86e4-2df8f611cb0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84850d55-275f-492c-80b3-7c12aa1b4831]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9476fd-2881-402f-800e-f4ca3ae5ff34]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e08cb0-9ec7-4dcb-8b47-570b08695d1b]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b4a08a-1920-4cc0-af61-e538e36d62d2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.134s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52377f1-af0d-4df5-a525-98bb0e58991c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260]
Jul 27 16:41:42 user nova-compute[71026]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20, portal: 172.16.0.220,3260] successful.
Jul 27 16:41:42 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57f705f9-2906-48b1-9155-5140ee439b20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe04c2-4bbe-4290-8347-7b7e85af25e0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== disconnect_volume: return (438ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-0abacbb8-126b-4e25-9446-5b37a880ebc2 req-09b3f77f-45c8-4957-a3a6-3b8b9d360c26 service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-unplugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Instance destroyed successfully.
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lazy-loading 'resources' on Instance uuid 1015a1e1-69ee-42a0-acf9-597323751110 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1261262759',display_name='tempest-ServerStableDeviceRescueTest-server-1261262759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1261262759',id=2,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLebzHT/ReLmyfHAdUDB+s5h41G6i1UV5+T2SutRBvBUAIHSxj5VOaNMFZJPVUjELdhNWD+XxOHbDEq+7+e0o2WOkTYoaKLr5EuwjT5kTOxp1j39vRQvjDNzn98rHbGmQg==',key_name='tempest-keypair-828655165',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:38:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bef5c245d5fe404083a2bf9b9f5060d0',ramdisk_id='',reservation_id='r-zn2vf2lx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1901406311',owner_user_name='tempest-ServerStableDeviceRescueTest-1901406311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:40:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7cdfafb6ab941ff86123b2f0dba6d77',uuid=1015a1e1-69ee-42a0-acf9-597323751110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converting VIF {"id": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "address": "fa:16:3e:15:10:68", "network": {"id": "91a3fd46-a30d-4920-8fa6-6a416bd174f8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1651938887-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bef5c245d5fe404083a2bf9b9f5060d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e3e2fd1-45", "ovs_interfaceid": "4e3e2fd1-45b3-46ee-85e8-0692ac6994ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG os_vif [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e3e2fd1-45, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:41:43 user nova-compute[71026]: INFO os_vif [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:10:68,bridge_name='br-int',has_traffic_filtering=True,id=4e3e2fd1-45b3-46ee-85e8-0692ac6994ee,network=Network(91a3fd46-a30d-4920-8fa6-6a416bd174f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e3e2fd1-45')
Jul 27 16:41:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Deleting instance files /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110_del
Jul 27 16:41:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Deletion of /opt/stack/data/nova/instances/1015a1e1-69ee-42a0-acf9-597323751110_del complete
Jul 27 16:41:43 user nova-compute[71026]: INFO nova.compute.manager [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Took 1.00 seconds to destroy the instance on the hypervisor.
Jul 27 16:41:43 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG nova.objects.instance [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:41:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-687f7fbd-3d95-4658-ad44-546d03961996 tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.085s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] Acquiring lock "1015a1e1-69ee-42a0-acf9-597323751110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] Lock "1015a1e1-69ee-42a0-acf9-597323751110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] No waiting events found dispatching network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:41:44 user nova-compute[71026]: WARNING nova.compute.manager [req-2bf6c96f-b942-49fd-ac0d-6dce885a00bf req-9a98128a-cfae-44cd-ac69-0060df2b99ec service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received unexpected event network-vif-plugged-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee for instance with vm_state active and task_state deleting.
Jul 27 16:41:45 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:41:45 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Took 1.71 seconds to deallocate network for instance.
Jul 27 16:41:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-7239f3c0-124f-4c84-a745-4f748f8407c4 req-eac500c3-da1d-4c8e-98f6-602fce56bacf service nova] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Received event network-vif-deleted-4e3e2fd1-45b3-46ee-85e8-0692ac6994ee {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:41:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:41:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:41:45 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:41:45 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:41:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:45 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Deleted allocations for instance 1015a1e1-69ee-42a0-acf9-597323751110
Jul 27 16:41:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fdbe2545-69b3-4c94-869d-928d277c4477 tempest-ServerStableDeviceRescueTest-1901406311 tempest-ServerStableDeviceRescueTest-1901406311-project-member] Lock "1015a1e1-69ee-42a0-acf9-597323751110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:41:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:58 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476103.2183726, 1015a1e1-69ee-42a0-acf9-597323751110 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:41:58 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] VM Stopped (Lifecycle Event)
Jul 27 16:41:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-81a1bea6-42c7-4c37-9ef2-af3c19f3db0c None None] [instance: 1015a1e1-69ee-42a0-acf9-597323751110] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:41:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:41:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:42:17 user nova-compute[71026]: INFO nova.compute.claims [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Claim successful on node user
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:42:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:42:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Creating image(s)
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "/opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "/opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG nova.policy [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '072754b24f114dea8b70d8ce6370d7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dac247d812f44c28c003f764b784304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.459s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:42:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7708MB free_disk=25.743640899658203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk 1073741824" returned: 0 in 0.059s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.524s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.159s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Cannot resize image /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'migration_context' on Instance uuid 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Ensure instance console log exists: /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:42:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Successfully created port: e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Successfully updated port: e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquired lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-changed-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Refreshing instance network info cache due to event network-changed-e396e883-942f-4131-bcbb-32e5cc866b74. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] Acquiring lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:42:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Skipping network cache update for instance because it is Building. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updating instance_info_cache with network_info: [{"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Releasing lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Instance network_info: |[{"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] Acquired lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Refreshing network info cache for port e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Start _get_guest_xml network_info=[{"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:42:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:42:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-173889736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-173889736',id=19,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp85++5OPICJthV8A8wWUohVMrvaeNitOY0af18cclBiKAvf5A5+kSBzjsdT3VJjNDKlUZ1RVNRSJ5Q7aFDovxMjwL9TjnPMEv/bhOjkYL9Q2chZVRnLuK67kQZkHnBIw==',key_name='tempest-keypair-1113239109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-dddadlyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=7aadd7d4-35d1-4dea-98b3-26c1c1f46de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:42:21 user nova-compute[71026]:   <uuid>7aadd7d4-35d1-4dea-98b3-26c1c1f46de8</uuid>
Jul 27 16:42:21 user nova-compute[71026]:   <name>instance-00000013</name>
Jul 27 16:42:21 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:42:21 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:42:21 user nova-compute[71026]:   <metadata>
Jul 27 16:42:21 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:42:21 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:name>tempest-ServerActionsV293TestJSON-server-173889736</nova:name>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:42:21</nova:creationTime>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:42:21 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:42:21 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:owner>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:user uuid="072754b24f114dea8b70d8ce6370d7e3">tempest-ServerActionsV293TestJSON-510559864-project-member</nova:user>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:project uuid="0dac247d812f44c28c003f764b784304">tempest-ServerActionsV293TestJSON-510559864</nova:project>
Jul 27 16:42:21 user nova-compute[71026]:       </nova:owner>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:42:21 user nova-compute[71026]:       <nova:ports>
Jul 27 16:42:21 user nova-compute[71026]:         <nova:port uuid="e396e883-942f-4131-bcbb-32e5cc866b74">
Jul 27 16:42:21 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:42:21 user nova-compute[71026]:         </nova:port>
Jul 27 16:42:21 user nova-compute[71026]:       </nova:ports>
Jul 27 16:42:21 user nova-compute[71026]:     </nova:instance>
Jul 27 16:42:21 user nova-compute[71026]:   </metadata>
Jul 27 16:42:21 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:42:21 user nova-compute[71026]:     <system>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="serial">7aadd7d4-35d1-4dea-98b3-26c1c1f46de8</entry>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="uuid">7aadd7d4-35d1-4dea-98b3-26c1c1f46de8</entry>
Jul 27 16:42:21 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:42:21 user nova-compute[71026]:     </system>
Jul 27 16:42:21 user nova-compute[71026]:   </sysinfo>
Jul 27 16:42:21 user nova-compute[71026]:   <os>
Jul 27 16:42:21 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:42:21 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:42:21 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:42:21 user nova-compute[71026]:   </os>
Jul 27 16:42:21 user nova-compute[71026]:   <features>
Jul 27 16:42:21 user nova-compute[71026]:     <acpi/>
Jul 27 16:42:21 user nova-compute[71026]:     <apic/>
Jul 27 16:42:21 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:42:21 user nova-compute[71026]:   </features>
Jul 27 16:42:21 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:42:21 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:42:21 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:42:21 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:42:21 user nova-compute[71026]:   </clock>
Jul 27 16:42:21 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:42:21 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:42:21 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:42:21 user nova-compute[71026]:   </cpu>
Jul 27 16:42:21 user nova-compute[71026]:   <devices>
Jul 27 16:42:21 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:42:21 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:42:21 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk"/>
Jul 27 16:42:21 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:42:21 user nova-compute[71026]:     </disk>
Jul 27 16:42:21 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:42:21 user nova-compute[71026]:       <mac address="fa:16:3e:f5:ec:ea"/>
Jul 27 16:42:21 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:42:21 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:42:21 user nova-compute[71026]:       <target dev="tape396e883-94"/>
Jul 27 16:42:21 user nova-compute[71026]:     </interface>
Jul 27 16:42:21 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:42:21 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/console.log" append="off"/>
Jul 27 16:42:21 user nova-compute[71026]:     </serial>
Jul 27 16:42:21 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:42:21 user nova-compute[71026]:     <video>
Jul 27 16:42:21 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:42:21 user nova-compute[71026]:     </video>
Jul 27 16:42:21 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:42:21 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:42:21 user nova-compute[71026]:     </rng>
Jul 27 16:42:21 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:42:21 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:42:21 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:42:21 user nova-compute[71026]:     </memballoon>
Jul 27 16:42:21 user nova-compute[71026]:   </devices>
Jul 27 16:42:21 user nova-compute[71026]: </domain>
Jul 27 16:42:21 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-173889736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-173889736',id=19,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp85++5OPICJthV8A8wWUohVMrvaeNitOY0af18cclBiKAvf5A5+kSBzjsdT3VJjNDKlUZ1RVNRSJ5Q7aFDovxMjwL9TjnPMEv/bhOjkYL9Q2chZVRnLuK67kQZkHnBIw==',key_name='tempest-keypair-1113239109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-dddadlyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=7aadd7d4-35d1-4dea-98b3-26c1c1f46de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG os_vif [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape396e883-94, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape396e883-94, col_values=(('external_ids', {'iface-id': 'e396e883-942f-4131-bcbb-32e5cc866b74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ec:ea', 'vm-uuid': '7aadd7d4-35d1-4dea-98b3-26c1c1f46de8'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:21 user nova-compute[71026]: INFO os_vif [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94')
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No VIF found with MAC fa:16:3e:f5:ec:ea, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updated VIF entry in instance network info cache for port e396e883-942f-4131-bcbb-32e5cc866b74. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updating instance_info_cache with network_info: [{"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:42:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b2267b5c-07fa-4a81-90eb-100e23eaf92f req-ebbb2a98-f23d-47ff-8ae5-a5d9324dbb69 service nova] Releasing lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:42:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] No waiting events found dispatching network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:42:23 user nova-compute[71026]: WARNING nova.compute.manager [req-e21c64fd-7c65-4167-b784-bb0e2775b0b5 req-23941a80-707e-432e-8133-a60d7c48c2e0 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received unexpected event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 for instance with vm_state building and task_state spawning.
Jul 27 16:42:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476144.9143362, 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:42:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] VM Resumed (Lifecycle Event)
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:42:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Instance spawned successfully.
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:42:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:42:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476144.915982, 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:42:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] VM Started (Lifecycle Event)
Jul 27 16:42:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:42:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:42:25 user nova-compute[71026]: INFO nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Took 6.39 seconds to spawn the instance on the hypervisor.
Jul 27 16:42:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:42:25 user nova-compute[71026]: INFO nova.compute.manager [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Took 7.35 seconds to build instance.
Jul 27 16:42:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2220a414-e5fe-443a-baba-16c26c003d17 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.523s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] No waiting events found dispatching network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:42:25 user nova-compute[71026]: WARNING nova.compute.manager [req-3bfe6bf8-adc5-4dd1-baeb-e6382dccf84e req-8c234d10-0c34-440c-a586-2aed98e0a003 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received unexpected event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 for instance with vm_state active and task_state None.
Jul 27 16:42:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:42:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG nova.objects.instance [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:38 user nova-compute[71026]: INFO nova.compute.manager [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attaching volume d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 to /dev/vdb
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.utils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23946696-de0b-47f3-86c1-1b0b0a6c78a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93adb4-74c9-44f3-a0ab-ca09c9fc3468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d29c53f-e8dd-4861-9294-5430d5435a43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c97dc-0014-4707-b805-2be25b2c2497]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:42:39 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:42:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ebce91-bba9-4796-b09b-138ccc988c7e]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG os_brick.utils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:42:39 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating existing volume attachment record: 03b7fda6-b602-4bc6-afd8-9fbe12fb5d44 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:42:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRWiqZau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:42:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:42:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:42:48 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7909fb5f-d7d4-4531-a977-2cff1f6d711c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:42:48 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabeb45f-cebc-4cf8-8922-f77005e91bcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80] added
Jul 27 16:42:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c4c6ef-e6e6-4c39-aa0e-9e58c1dedce2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e19b6f1-db9c-40a1-8190-56f7a1e15c30]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRWiqZau {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRWiqZau" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6319368f-445f-40da-8c8e-74f890b965a7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRWiqZau'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1210e1b6-68e9-4e0e-a607-5012d7fcab91]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddfcd81-8975-4718-bb6d-deef99a27bf2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b8e23-0958-417a-ae35-8f3218117f62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260]
Jul 27 16:42:49 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260] successful.
Jul 27 16:42:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3031d-c403-46e8-9102-fb419799bc51]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc9836b-cfb3-4fbf-86e7-114dee758020]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)
Jul 27 16:42:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5f414f-dab5-4bf8-86d2-78221c4b5a2b]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRWiqZau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26230313233353930', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230313233353930', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:42:50 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:42:50 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:42:50 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:42:50 user nova-compute[71026]:   <serial>d8dd31c7-4aec-40db-bc21-8bd42b6e9b80</serial>
Jul 27 16:42:50 user nova-compute[71026]: </disk>
Jul 27 16:42:50 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] No VIF found with MAC fa:16:3e:70:6e:3a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:42:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ad39b166-cd00-42ab-a631-da9201c39fee tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.834s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:53 user nova-compute[71026]: INFO nova.compute.manager [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Detaching volume d8dd31c7-4aec-40db-bc21-8bd42b6e9b80
Jul 27 16:42:53 user nova-compute[71026]: INFO nova.virt.block_device [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Attempting to driver detach volume d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 from mountpoint /dev/vdb
Jul 27 16:42:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Attempting to detach device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:42:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:42:53 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:42:53 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:42:53 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:42:53 user nova-compute[71026]:   <serial>d8dd31c7-4aec-40db-bc21-8bd42b6e9b80</serial>
Jul 27 16:42:53 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:42:53 user nova-compute[71026]: </disk>
Jul 27 16:42:53 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:42:53 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the persistent domain config.
Jul 27 16:42:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:42:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:42:53 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:42:53 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:42:53 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:42:53 user nova-compute[71026]:   <serial>d8dd31c7-4aec-40db-bc21-8bd42b6e9b80</serial>
Jul 27 16:42:53 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:42:53 user nova-compute[71026]: </disk>
Jul 27 16:42:53 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476174.2605922, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:42:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully detached device vdb from instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 from the live domain config.
Jul 27 16:42:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRWiqZau', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:42:54 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b48698-b0e6-4fc1-8e8b-2e7c4a63f183]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:42:54 user nova-compute[71026]: No targets found.
Jul 27 16:42:54 user nova-compute[71026]: iSNS:
Jul 27 16:42:54 user nova-compute[71026]: No targets found.
Jul 27 16:42:54 user nova-compute[71026]: STATIC:
Jul 27 16:42:54 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:42:54 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:42:54 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:42:54 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80
Jul 27 16:42:54 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:42:54 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:42:54 user nova-compute[71026]: FIRMWARE:
Jul 27 16:42:54 user nova-compute[71026]: No targets found.
Jul 27 16:42:54 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:42:54 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:42:54 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8dd5b0-0b1e-4068-90c9-9a931171814e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5428c32-7ee3-44cf-b74d-0cb3ba0c1e76]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:54 user nova-compute[71026]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)
Jul 27 16:42:54 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:42:54 user nova-compute[71026]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 (non-flash)
Jul 27 16:42:54 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088543e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5713ca0e-8962-4bbe-ab1a-25e9fe40a970]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ce44f-c7b4-45ff-94d8-48322633aaff]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589f7bb-83d7-437d-a77f-af1b5f3fa4ea]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff04764-df7f-4f3c-8de0-d97d6e2b37dc]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[322613bb-3cb0-4a3d-bd4d-a1a3cfb5b226]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb4c20-9329-4447-903e-4427cde9f18d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260]
Jul 27 16:42:54 user nova-compute[71026]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80, portal: 172.16.0.220,3260] successful.
Jul 27 16:42:54 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8dd31c7-4aec-40db-bc21-8bd42b6e9b80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c81900-62a1-40a0-8df0-28d28beec476]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] <== disconnect_volume: return (303ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:42:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:42:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'flavor' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b6e4ea7-bc59-42f3-8aba-14c42d91255c tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.911s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG nova.objects.instance [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'flavor' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:57 user nova-compute[71026]: INFO nova.compute.manager [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attaching volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 to /dev/vdb
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.utils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[860aa34f-6d3c-47a4-aa56-1fd567c010df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e21be-2d3c-4757-a8ab-e33e32846227]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19da56b-e77d-46d1-8bd7-ce85f8480a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc66e2d1-69dd-4b96-8e96-5490790e8d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:42:58 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:42:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221a932-0244-49a9-a062-c1881bfff4f2]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG os_brick.utils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating existing volume attachment record: 393de649-974e-4b47-af87-1fd4bcdc448d {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:42:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:42:59 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:42:59 user nova-compute[71026]: INFO nova.compute.claims [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Claim successful on node user
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:43:00 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.policy [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421dd87102724509a506e368de55faaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6408faede31045a6a3a34304629caa4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:43:00 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Creating image(s)
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk 1073741824" returned: 0 in 0.055s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Cannot resize image /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Ensure instance console log exists: /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:01 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Successfully created port: 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Successfully updated port: 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing instance network info cache due to event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:43:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance network_info: |[{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start _get_guest_xml network_info=[{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:43:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:43:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-244159089',display_name='tempest-ServerRescueNegativeTestJSON-server-244159089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-244159089',id=20,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbVZbxraV9LLAYbitENvm7qE5uy+asL3RJ5zJAybGKiBTF8Cdyko5Af5r0bkNToPHY27EbQT7Kx7HbEjndoXMvYFbm0Z4E7mhy1JznNARq3v1wSjZFDVJ/NWdB1AypIPA==',key_name='tempest-keypair-1386888906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-f67li0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421dd87102724509a506e368de55faaf',uuid=3550a85d-ed4d-4728-8398-23a171e6f40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:43:03 user nova-compute[71026]:   <uuid>3550a85d-ed4d-4728-8398-23a171e6f40d</uuid>
Jul 27 16:43:03 user nova-compute[71026]:   <name>instance-00000014</name>
Jul 27 16:43:03 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:43:03 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:43:03 user nova-compute[71026]:   <metadata>
Jul 27 16:43:03 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:43:03 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-244159089</nova:name>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:43:03</nova:creationTime>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:43:03 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:43:03 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:owner>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:43:03 user nova-compute[71026]:       </nova:owner>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:43:03 user nova-compute[71026]:       <nova:ports>
Jul 27 16:43:03 user nova-compute[71026]:         <nova:port uuid="8f907dad-0ec6-4443-83df-f6a5ad7b811d">
Jul 27 16:43:03 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 16:43:03 user nova-compute[71026]:         </nova:port>
Jul 27 16:43:03 user nova-compute[71026]:       </nova:ports>
Jul 27 16:43:03 user nova-compute[71026]:     </nova:instance>
Jul 27 16:43:03 user nova-compute[71026]:   </metadata>
Jul 27 16:43:03 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:43:03 user nova-compute[71026]:     <system>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="serial">3550a85d-ed4d-4728-8398-23a171e6f40d</entry>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="uuid">3550a85d-ed4d-4728-8398-23a171e6f40d</entry>
Jul 27 16:43:03 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:43:03 user nova-compute[71026]:     </system>
Jul 27 16:43:03 user nova-compute[71026]:   </sysinfo>
Jul 27 16:43:03 user nova-compute[71026]:   <os>
Jul 27 16:43:03 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:43:03 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:43:03 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:43:03 user nova-compute[71026]:   </os>
Jul 27 16:43:03 user nova-compute[71026]:   <features>
Jul 27 16:43:03 user nova-compute[71026]:     <acpi/>
Jul 27 16:43:03 user nova-compute[71026]:     <apic/>
Jul 27 16:43:03 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:43:03 user nova-compute[71026]:   </features>
Jul 27 16:43:03 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:43:03 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:43:03 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:43:03 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:43:03 user nova-compute[71026]:   </clock>
Jul 27 16:43:03 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:43:03 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:43:03 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:43:03 user nova-compute[71026]:   </cpu>
Jul 27 16:43:03 user nova-compute[71026]:   <devices>
Jul 27 16:43:03 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:43:03 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:43:03 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk"/>
Jul 27 16:43:03 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:43:03 user nova-compute[71026]:     </disk>
Jul 27 16:43:03 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:43:03 user nova-compute[71026]:       <mac address="fa:16:3e:2b:2b:8e"/>
Jul 27 16:43:03 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:43:03 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:43:03 user nova-compute[71026]:       <target dev="tap8f907dad-0e"/>
Jul 27 16:43:03 user nova-compute[71026]:     </interface>
Jul 27 16:43:03 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:43:03 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/console.log" append="off"/>
Jul 27 16:43:03 user nova-compute[71026]:     </serial>
Jul 27 16:43:03 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:43:03 user nova-compute[71026]:     <video>
Jul 27 16:43:03 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:43:03 user nova-compute[71026]:     </video>
Jul 27 16:43:03 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:43:03 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:43:03 user nova-compute[71026]:     </rng>
Jul 27 16:43:03 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:43:03 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:43:03 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:43:03 user nova-compute[71026]:     </memballoon>
Jul 27 16:43:03 user nova-compute[71026]:   </devices>
Jul 27 16:43:03 user nova-compute[71026]: </domain>
Jul 27 16:43:03 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-244159089',display_name='tempest-ServerRescueNegativeTestJSON-server-244159089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-244159089',id=20,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbVZbxraV9LLAYbitENvm7qE5uy+asL3RJ5zJAybGKiBTF8Cdyko5Af5r0bkNToPHY27EbQT7Kx7HbEjndoXMvYFbm0Z4E7mhy1JznNARq3v1wSjZFDVJ/NWdB1AypIPA==',key_name='tempest-keypair-1386888906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-f67li0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421dd87102724509a506e368de55faaf',uuid=3550a85d-ed4d-4728-8398-23a171e6f40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG os_vif [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f907dad-0e, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f907dad-0e, col_values=(('external_ids', {'iface-id': '8f907dad-0ec6-4443-83df-f6a5ad7b811d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:2b:8e', 'vm-uuid': '3550a85d-ed4d-4728-8398-23a171e6f40d'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:03 user nova-compute[71026]: INFO os_vif [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e')
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:2b:2b:8e, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updated VIF entry in instance network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50e4e08b-9eeb-4834-9925-c02433dfc384 req-d877fb0d-4090-48e1-bb49-f1f872a231a0 service nova] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:43:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:05 user nova-compute[71026]: WARNING nova.compute.manager [req-8a0f9843-59c1-4648-b9c9-ba2b2b2321a3 req-b449e61c-3900-4071-b6aa-a77aeaa70340 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state building and task_state spawning.
Jul 27 16:43:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:05 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:05 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:05 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9111ac59-7e47-43b1-adae-2fc78d8b99ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:43:05 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[808e087b-dfe5-4252-80a8-ab10c68d30f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1] added
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[311ad573-47e2-4411-b72a-8054b8f8fca4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded424b-4616-4ad9-9c48-6deffa0e17bc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYNqExRW {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYNqExRW" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833cf70-fb23-4d9e-afe1-04c7b7534576]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYNqExRW'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f616213a-b5ec-4b3f-bdc3-9d7c33ff282f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a077c-0938-49a8-a006-ffd0d60a23ec]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21638217-a215-45cb-940a-804d7ce8246f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]
Jul 27 16:43:05 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8ce23-c37f-4022-8e3c-bbbe916df460]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386cf9e-da16-4589-a25f-5497aaa65a4e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34869ef3-e91a-4fc0-be72-9a075bf0bf14]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:43:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:43:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26362323037653935', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323037653935', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:43:06 user nova-compute[71026]: DEBUG nova.objects.instance [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'flavor' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:43:06 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:06 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:43:06 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:43:06 user nova-compute[71026]:   <serial>d5fd19b0-0fd0-4b88-8402-99ca5096dbb1</serial>
Jul 27 16:43:06 user nova-compute[71026]: </disk>
Jul 27 16:43:06 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476187.082847, 3550a85d-ed4d-4728-8398-23a171e6f40d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Resumed (Lifecycle Event)
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance spawned successfully.
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476187.0867922, 3550a85d-ed4d-4728-8398-23a171e6f40d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Started (Lifecycle Event)
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:07 user nova-compute[71026]: WARNING nova.compute.manager [req-23bd0f52-a6b3-4fb8-80db-5f7559a1d663 req-7406a345-cf64-46a9-9c56-5bff5a89bf7a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state building and task_state spawning.
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Took 6.41 seconds to spawn the instance on the hypervisor.
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:07 user nova-compute[71026]: INFO nova.compute.manager [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Took 7.45 seconds to build instance.
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No VIF found with MAC fa:16:3e:7c:3e:82, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2b26943a-17fc-4b0d-b719-664e23e5614c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.552s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63d7ddb3-c554-4196-a973-0ed0dbefd26e tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.545s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:08 user nova-compute[71026]: INFO nova.compute.manager [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Rebuilding instance
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_requests' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_devices' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'resources' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'migration_context' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71026) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:09 user nova-compute[71026]: WARNING nova.compute.manager [req-5b4986e1-97a4-40a8-9336-378328dc8a3a req-75750191-0c73-495e-81c5-a6b56e0eb295 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state active and task_state rebuilding.
Jul 27 16:43:09 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance destroyed successfully.
Jul 27 16:43:09 user nova-compute[71026]: INFO nova.compute.manager [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Detaching volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1
Jul 27 16:43:09 user nova-compute[71026]: INFO nova.virt.block_device [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attempting to driver detach volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 from mountpoint /dev/vdb
Jul 27 16:43:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Attempting to detach device vdb from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:43:09 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:09 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:43:09 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:43:09 user nova-compute[71026]:   <serial>d5fd19b0-0fd0-4b88-8402-99ca5096dbb1</serial>
Jul 27 16:43:09 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:43:09 user nova-compute[71026]: </disk>
Jul 27 16:43:09 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:43:09 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully detached device vdb from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the persistent domain config.
Jul 27 16:43:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:09 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c105e5a7-4f84-48a8-89be-4627f62ffafc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:43:09 user nova-compute[71026]: No targets found.
Jul 27 16:43:09 user nova-compute[71026]: iSNS:
Jul 27 16:43:09 user nova-compute[71026]: No targets found.
Jul 27 16:43:09 user nova-compute[71026]: STATIC:
Jul 27 16:43:09 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:43:09 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:09 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:09 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1
Jul 27 16:43:09 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:09 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:09 user nova-compute[71026]: FIRMWARE:
Jul 27 16:43:09 user nova-compute[71026]: No targets found.
Jul 27 16:43:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:43:09 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:43:09 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf4c604-e7c3-4386-9aab-f9a8e82d86d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd39bd75-08d6-44c4-9319-6f5bac5c08bd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:09 user nova-compute[71026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:09 user nova-compute[71026]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308868fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158789d-9474-4983-a557-9789bc8ac3d9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8253b86d-7968-4a94-bca5-e5a46c654f26]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbb6979-bddb-4f3f-9bd4-0f8f8a3a8290]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:43:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052fd1d-d2d9-4376-9341-c35169583246]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86516579-f79f-4d7a-96e7-21a3ac33e2a9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe8470-df62-491a-8393-38709ba7c0d1]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]
Jul 27 16:43:10 user nova-compute[71026]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[255f0c87-39f3-4c1c-9d70-97c4a3b3c3d1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== disconnect_volume: return (328ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:43:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance destroyed successfully.
Jul 27 16:43:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-1391208785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd92f92-52, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:10 user nova-compute[71026]: INFO os_vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52')
Jul 27 16:43:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c2a61-50f7-4814-87ce-02ef5ecc9350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:43:11 user nova-compute[71026]: No targets found.
Jul 27 16:43:11 user nova-compute[71026]: iSNS:
Jul 27 16:43:11 user nova-compute[71026]: No targets found.
Jul 27 16:43:11 user nova-compute[71026]: STATIC:
Jul 27 16:43:11 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:43:11 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:11 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:11 user nova-compute[71026]: FIRMWARE:
Jul 27 16:43:11 user nova-compute[71026]: No targets found.
Jul 27 16:43:11 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:43:11 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:43:11 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d946ab-55b3-4048-a7f5-60f29ca47523]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[840438bf-7708-4ed9-a6ca-bc969773598a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:11 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:11 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30b74b2f80>, {}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Disconnecting from: [] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== disconnect_volume: return (75ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:43:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Deleting instance files /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6_del
Jul 27 16:43:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Deletion of /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6_del complete
Jul 27 16:43:11 user nova-compute[71026]: INFO nova.virt.block_device [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Booting with volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 at /dev/vdb
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.utils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2633851-af6f-4ba1-8f9d-541b50d25ce0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f35b04-d0de-4932-8ba5-e60ecf4775ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[93741253-708a-4500-af37-e536eb9b0cde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[679c7baa-8bfe-409c-b978-28a48b2edd01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:43:11 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ecdd74-16ab-403c-af14-f2d09397e495]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG os_brick.utils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating existing volume attachment record: e5c48fd0-5826-404e-a221-eeb648aa410c {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:11 user nova-compute[71026]: WARNING nova.compute.manager [req-36e5dcd9-a9f5-43e9-bacb-833c5d204a4c req-ef032e1d-7954-43fe-87e0-43310c357a57 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state active and task_state rebuild_block_device_mapping.
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:11 user nova-compute[71026]: INFO nova.compute.manager [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Terminating instance
Jul 27 16:43:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Instance destroyed successfully.
Jul 27 16:43:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lazy-loading 'resources' on Instance uuid 790cd259-4d88-427a-acf4-d4d70c9fc8d1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1556874473',display_name='tempest-ServerActionsTestOtherB-server-1556874473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1556874473',id=6,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkDwWQDz2QfZFUoEvQID0aeMqxwoVTJRWDG67/JpJnoPhn5/JrL/C0fzIYpKk39TJt+vt9N/t4notTPpJ+Ny5z8FBMt7JpM9upDqmbYvoQkxlZB6Jb0PhEtAb7yitIbLQ==',key_name='tempest-keypair-412961333',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff31b3d25a99410aab34dff6c445ff44',ramdisk_id='',reservation_id='r-g1ngpmoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-496611114',owner_user_name='tempest-ServerActionsTestOtherB-496611114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145d143ed66e4ddd9708b36e6ddeeb09',uuid=790cd259-4d88-427a-acf4-d4d70c9fc8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converting VIF {"id": "dbd736b7-dabf-4687-845b-afd30024718d", "address": "fa:16:3e:cb:e0:30", "network": {"id": "70ec7a43-16c5-4453-895c-283c17112794", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-193041218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff31b3d25a99410aab34dff6c445ff44", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbd736b7-da", "ovs_interfaceid": "dbd736b7-dabf-4687-845b-afd30024718d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_vif [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbd736b7-da, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:43:12 user nova-compute[71026]: INFO os_vif [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e0:30,bridge_name='br-int',has_traffic_filtering=True,id=dbd736b7-dabf-4687-845b-afd30024718d,network=Network(70ec7a43-16c5-4453-895c-283c17112794),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbd736b7-da')
Jul 27 16:43:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ECbozTuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:12 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5c935-4c19-4131-a393-dca52cd07b7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:43:12 user nova-compute[71026]: No targets found.
Jul 27 16:43:12 user nova-compute[71026]: iSNS:
Jul 27 16:43:12 user nova-compute[71026]: No targets found.
Jul 27 16:43:12 user nova-compute[71026]: STATIC:
Jul 27 16:43:12 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979
Jul 27 16:43:12 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:12 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:12 user nova-compute[71026]: FIRMWARE:
Jul 27 16:43:12 user nova-compute[71026]: No targets found.
Jul 27 16:43:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:43:12 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:43:12 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da4dfb-13d1-40ed-a183-f13cced50421]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1759aca6-44ad-467f-a0d3-61c426f5e711]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 (non-flash)
Jul 27 16:43:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308870cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03e6784-bf45-45bb-800e-c0b64c02e10b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6be5454-8ea4-415d-91c1-2a21a70295be]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ac1f9d-a9fd-421b-931a-69f400595267]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f662b76-d2bd-4346-ac28-3feac069cdad]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2af0517-f736-45a6-b5c5-36b299a09f2a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[220132d0-2f11-4f10-bd21-7dc6fb46f955]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260]
Jul 27 16:43:13 user nova-compute[71026]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d46bf45-57e8-4cdb-bebe-11c2f0dec979 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de0cbc-0a07-4abb-a4d2-7976538f7164]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] <== disconnect_volume: return (323ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:43:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Deleting instance files /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_del
Jul 27 16:43:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Deletion of /opt/stack/data/nova/instances/790cd259-4d88-427a-acf4-d4d70c9fc8d1_del complete
Jul 27 16:43:13 user nova-compute[71026]: INFO nova.compute.manager [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Took 1.41 seconds to destroy the instance on the hypervisor.
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-unplugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Acquiring lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] No waiting events found dispatching network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:13 user nova-compute[71026]: WARNING nova.compute.manager [req-120c0177-0ce5-434d-9796-93a4625ff994 req-dd24ccb3-8b6d-40d9-b531-2d58043e0e9c service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received unexpected event network-vif-plugged-dbd736b7-dabf-4687-845b-afd30024718d for instance with vm_state active and task_state deleting.
Jul 27 16:43:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:14 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:14 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Took 1.05 seconds to deallocate network for instance.
Jul 27 16:43:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-06d958ce-52da-483c-aebd-960872022058 req-753e20d8-ea14-4e61-add2-23e3fe72cd75 service nova] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Received event network-vif-deleted-dbd736b7-dabf-4687-845b-afd30024718d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:15 user nova-compute[71026]: INFO nova.compute.manager [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Took 0.87 seconds to detach 1 volumes for instance.
Jul 27 16:43:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:15 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:43:15 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:43:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:15 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Deleted allocations for instance 790cd259-4d88-427a-acf4-d4d70c9fc8d1
Jul 27 16:43:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-71065c56-6844-43dd-8df7-9e2e483f379e tempest-ServerActionsTestOtherB-496611114 tempest-ServerActionsTestOtherB-496611114-project-member] Lock "790cd259-4d88-427a-acf4-d4d70c9fc8d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.060s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:18 user nova-compute[71026]: INFO nova.compute.manager [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Terminating instance
Jul 27 16:43:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-unplugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] No waiting events found dispatching network-vif-unplugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-97eab76d-2e21-4a47-98c1-6b0f4ce59449 req-cd1bf533-3211-483c-9af9-cc78b5f7cca6 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-unplugged-130ef235-341f-4565-8f12-e7b5e644fae3 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Instance destroyed successfully.
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lazy-loading 'resources' on Instance uuid 7057a6bb-81b2-42a9-910c-c264a450fa20 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1378519878',display_name='tempest-ServersNegativeTestJSON-server-1378519878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1378519878',id=4,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='861424cabfc04dcd801426788ce536d3',ramdisk_id='',reservation_id='r-z00xcx1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1653924088',owner_user_name='tempest-ServersNegativeTestJSON-1653924088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:34:43Z,user_data=None,user_id='0ce09c32af684da283531bdabc3e15a7',uuid=7057a6bb-81b2-42a9-910c-c264a450fa20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converting VIF {"id": "130ef235-341f-4565-8f12-e7b5e644fae3", "address": "fa:16:3e:6e:10:df", "network": {"id": "a87e52a3-2897-4662-a793-8d3a45b10107", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1709514795-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "861424cabfc04dcd801426788ce536d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130ef235-34", "ovs_interfaceid": "130ef235-341f-4565-8f12-e7b5e644fae3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG os_vif [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap130ef235-34, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:43:19 user nova-compute[71026]: INFO os_vif [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:10:df,bridge_name='br-int',has_traffic_filtering=True,id=130ef235-341f-4565-8f12-e7b5e644fae3,network=Network(a87e52a3-2897-4662-a793-8d3a45b10107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130ef235-34')
Jul 27 16:43:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Deleting instance files /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20_del
Jul 27 16:43:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Deletion of /opt/stack/data/nova/instances/7057a6bb-81b2-42a9-910c-c264a450fa20_del complete
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:19 user nova-compute[71026]: INFO nova.compute.manager [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:43:19 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.74746322631836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:43:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Creating image(s)
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e6154c2b-855a-4baf-b3e0-e1dee76110b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:43:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk 1073741824" returned: 0 in 0.055s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d534d93-1b50-4f30-ae0f-99cf89f3e184 req-b447c26f-b98b-4d14-a5f3-bb672ba01052 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-deleted-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:20 user nova-compute[71026]: INFO nova.compute.manager [req-1d534d93-1b50-4f30-ae0f-99cf89f3e184 req-b447c26f-b98b-4d14-a5f3-bb672ba01052 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Neutron deleted interface 130ef235-341f-4565-8f12-e7b5e644fae3; detaching it from the instance and deleting it from the info cache
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d534d93-1b50-4f30-ae0f-99cf89f3e184 req-b447c26f-b98b-4d14-a5f3-bb672ba01052 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d534d93-1b50-4f30-ae0f-99cf89f3e184 req-b447c26f-b98b-4d14-a5f3-bb672ba01052 service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Detach interface failed, port_id=130ef235-341f-4565-8f12-e7b5e644fae3, reason: Instance 7057a6bb-81b2-42a9-910c-c264a450fa20 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:43:20 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Took 1.23 seconds to deallocate network for instance.
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] Acquiring lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] No waiting events found dispatching network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:20 user nova-compute[71026]: WARNING nova.compute.manager [req-f862b765-e8f8-48ce-91eb-3dd52a3f251c req-25aca80b-6716-407a-ac4f-3f618afb2bde service nova] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Received unexpected event network-vif-plugged-130ef235-341f-4565-8f12-e7b5e644fae3 for instance with vm_state deleted and task_state None.
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Cannot resize image /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Ensure instance console log exists: /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start _get_guest_xml network_info=[{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e5c48fd0-5826-404e-a221-eeb648aa410c', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3037d3ff-300a-42b0-a022-3aa1e9df52a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'serial': 'd5fd19b0-0fd0-4b88-8402-99ca5096dbb1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:43:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 16:43:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:20 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[975755a1-6bd0-4e6e-ae82-1ff872cc9fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:43:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35f8a0f-acab-468a-bf57-2611c130c522]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1] added
Jul 27 16:43:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b51bf65-2171-40be-bf22-09848478dbe5]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4645ee4-6893-4a90-b560-511198ef8a00]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYNqExRW {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYNqExRW" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acf3dc-709f-43ee-b484-4182961976e7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYNqExRW'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25efdbb-456d-47ae-b03e-e3f1e91d2977]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[841290ed-b768-4264-8a1e-f503738815cf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:43:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 16:43:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 16:43:20 user nova-compute[71026]: : NotImplementedError
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Deleted allocations for instance 7057a6bb-81b2-42a9-910c-c264a450fa20
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[881e3220-ae46-4bb7-a610-780743210dd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]
Jul 27 16:43:20 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0463d14d-bf2a-4923-a278-bc207869b5c3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c19af-f8df-499a-8f5e-a41d755ac435]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46ae64bc-b40d-49f9-83b1-847b81b7efea tempest-ServersNegativeTestJSON-1653924088 tempest-ServersNegativeTestJSON-1653924088-project-member] Lock "7057a6bb-81b2-42a9-910c-c264a450fa20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.954s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1302b85f-0c15-47fe-8a49-d2e3eab77076]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:43:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26362323037653935', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323037653935', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-1391208785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:43:22 user nova-compute[71026]:   <uuid>3037d3ff-300a-42b0-a022-3aa1e9df52a6</uuid>
Jul 27 16:43:22 user nova-compute[71026]:   <name>instance-00000011</name>
Jul 27 16:43:22 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:43:22 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:43:22 user nova-compute[71026]:   <metadata>
Jul 27 16:43:22 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:43:22 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherA-server-1391208785</nova:name>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:43:20</nova:creationTime>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:43:22 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:43:22 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:owner>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:user uuid="e106be16f498443091e8ae9f95311beb">tempest-ServerActionsTestOtherA-1832986311-project-member</nova:user>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:project uuid="40b15450553d464cbeac2d3d910e8043">tempest-ServerActionsTestOtherA-1832986311</nova:project>
Jul 27 16:43:22 user nova-compute[71026]:       </nova:owner>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:43:22 user nova-compute[71026]:       <nova:ports>
Jul 27 16:43:22 user nova-compute[71026]:         <nova:port uuid="edd92f92-526b-4110-9219-7dce34224f86">
Jul 27 16:43:22 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 16:43:22 user nova-compute[71026]:         </nova:port>
Jul 27 16:43:22 user nova-compute[71026]:       </nova:ports>
Jul 27 16:43:22 user nova-compute[71026]:     </nova:instance>
Jul 27 16:43:22 user nova-compute[71026]:   </metadata>
Jul 27 16:43:22 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:43:22 user nova-compute[71026]:     <system>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="serial">3037d3ff-300a-42b0-a022-3aa1e9df52a6</entry>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="uuid">3037d3ff-300a-42b0-a022-3aa1e9df52a6</entry>
Jul 27 16:43:22 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:43:22 user nova-compute[71026]:     </system>
Jul 27 16:43:22 user nova-compute[71026]:   </sysinfo>
Jul 27 16:43:22 user nova-compute[71026]:   <os>
Jul 27 16:43:22 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:43:22 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:43:22 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:43:22 user nova-compute[71026]:   </os>
Jul 27 16:43:22 user nova-compute[71026]:   <features>
Jul 27 16:43:22 user nova-compute[71026]:     <acpi/>
Jul 27 16:43:22 user nova-compute[71026]:     <apic/>
Jul 27 16:43:22 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:43:22 user nova-compute[71026]:   </features>
Jul 27 16:43:22 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:43:22 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:43:22 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:43:22 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:43:22 user nova-compute[71026]:   </clock>
Jul 27 16:43:22 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:43:22 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:43:22 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:43:22 user nova-compute[71026]:   </cpu>
Jul 27 16:43:22 user nova-compute[71026]:   <devices>
Jul 27 16:43:22 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:43:22 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:43:22 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk"/>
Jul 27 16:43:22 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:43:22 user nova-compute[71026]:     </disk>
Jul 27 16:43:22 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:43:22 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:22 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:43:22 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:43:22 user nova-compute[71026]:       <serial>d5fd19b0-0fd0-4b88-8402-99ca5096dbb1</serial>
Jul 27 16:43:22 user nova-compute[71026]:     </disk>
Jul 27 16:43:22 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:43:22 user nova-compute[71026]:       <mac address="fa:16:3e:7c:3e:82"/>
Jul 27 16:43:22 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:43:22 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:43:22 user nova-compute[71026]:       <target dev="tapedd92f92-52"/>
Jul 27 16:43:22 user nova-compute[71026]:     </interface>
Jul 27 16:43:22 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:43:22 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/console.log" append="off"/>
Jul 27 16:43:22 user nova-compute[71026]:     </serial>
Jul 27 16:43:22 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:43:22 user nova-compute[71026]:     <video>
Jul 27 16:43:22 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:43:22 user nova-compute[71026]:     </video>
Jul 27 16:43:22 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:43:22 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:43:22 user nova-compute[71026]:     </rng>
Jul 27 16:43:22 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:43:22 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:43:22 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:43:22 user nova-compute[71026]:     </memballoon>
Jul 27 16:43:22 user nova-compute[71026]:   </devices>
Jul 27 16:43:22 user nova-compute[71026]: </domain>
Jul 27 16:43:22 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-1391208785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG os_vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd92f92-52, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedd92f92-52, col_values=(('external_ids', {'iface-id': 'edd92f92-526b-4110-9219-7dce34224f86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:3e:82', 'vm-uuid': '3037d3ff-300a-42b0-a022-3aa1e9df52a6'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:22 user nova-compute[71026]: INFO os_vif [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52')
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No VIF found with MAC fa:16:3e:7c:3e:82, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-changed-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Refreshing instance network info cache due to event network-changed-eccba2a6-423a-428b-a59c-377a2aabcb9b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] Acquiring lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] Acquired lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Refreshing network info cache for port eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updated VIF entry in instance network info cache for port eccba2a6-423a-428b-a59c-377a2aabcb9b. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updating instance_info_cache with network_info: [{"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:43:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bae2f528-376f-478a-8a66-3d350025ab92 req-9dd99baf-077b-42f9-a6ec-182c77de3e85 service nova] Releasing lock "refresh_cache-a5c6cc55-aab2-4594-ba5a-1aef54b50a79" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:43:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:24 user nova-compute[71026]: WARNING nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:43:24 user nova-compute[71026]: WARNING nova.compute.manager [req-c636c0a2-77bd-4383-9049-caf57d39d945 req-f20cfe06-433a-45c3-83bb-fa41b06e60af service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476189.5715425, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:24 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Stopped (Lifecycle Event)
Jul 27 16:43:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-80c71a03-0fe7-425e-9512-988a69062bc1 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476205.5765104, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Resumed (Lifecycle Event)
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:43:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance spawned successfully.
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:43:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476205.5768461, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Started (Lifecycle Event)
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:43:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71026) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-fa1b8e38-4cc2-4792-b1ab-bb9a4c801524 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'flavor' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:26 user nova-compute[71026]: INFO nova.compute.manager [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Attaching volume 701e538c-71d5-4f4c-9858-0d851bd9181e to /dev/vdb
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0347aa74-36e4-4fee-8fe1-d405b84003aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0966ce-a7b4-4915-9148-1cff96df733f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b923b-cbd2-4aac-8daa-ab8f22be5ceb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8597500-8394-43a3-bf61-b80b985e0411]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:43:26 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:43:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1246904-016c-4c6d-ba5c-89ffce1df1ab]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:26 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updating existing volume attachment record: 54d9fb72-4967-4acf-97ae-0ea21ceac102 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:43:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:27 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476192.697748, 790cd259-4d88-427a-acf4-d4d70c9fc8d1 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:27 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] VM Stopped (Lifecycle Event)
Jul 27 16:43:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3c3e1799-1cfd-447c-a169-6061fd1b2572 None None] [instance: 790cd259-4d88-427a-acf4-d4d70c9fc8d1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:33 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476198.9724302, 7057a6bb-81b2-42a9-910c-c264a450fa20 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:43:33 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] VM Stopped (Lifecycle Event)
Jul 27 16:43:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7b1140e6-fd9a-4b00-8c1c-ff8e3b784786 None None] [instance: 7057a6bb-81b2-42a9-910c-c264a450fa20] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEQOBuxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:34 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a9ee17-fb32-4647-aeac-12c46fbebf8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:43:34 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c0a10-d248-4589-917c-4e0d7ed9aec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e] added
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065ebfe-38e0-48ce-a900-995c47b2a31e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7e8351-2906-4441-b5e9-b79cbaf6a828]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEQOBuxW {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEQOBuxW" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15801d0d-965f-4edf-a525-f6ca681f6145]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEQOBuxW'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e94742-8b33-45f8-aa7c-5b2a533bb54f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[475bac53-b472-4cb8-ab88-6f31c723efea]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea56db9-acb9-48bb-b825-193d2b1474b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260]
Jul 27 16:43:34 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e803bd-0599-4ece-a4e1-8dd8c059988a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5cba6-b191-4ddc-b732-8ceebe08bd66]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:34 user nova-compute[71026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:34 user nova-compute[71026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)
Jul 27 16:43:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e86833d-05a6-4a50-ba62-7bf8344756f0]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:43:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEQOBuxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:43:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23932303461383132', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932303461383132', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:43:35 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'flavor' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:43:35 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:35 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:43:35 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:43:35 user nova-compute[71026]:   <serial>701e538c-71d5-4f4c-9858-0d851bd9181e</serial>
Jul 27 16:43:35 user nova-compute[71026]: </disk>
Jul 27 16:43:35 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:43:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:43:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] No VIF found with MAC fa:16:3e:45:99:6a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:43:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bc7141e7-2327-434b-8f92-7f99108688d1 tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.464s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:43:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:43:39 user nova-compute[71026]: INFO nova.compute.manager [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Detaching volume 701e538c-71d5-4f4c-9858-0d851bd9181e
Jul 27 16:43:39 user nova-compute[71026]: INFO nova.virt.block_device [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Attempting to driver detach volume 701e538c-71d5-4f4c-9858-0d851bd9181e from mountpoint /dev/vdb
Jul 27 16:43:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Attempting to detach device vdb from instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:43:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:43:39 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:39 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:43:39 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:43:39 user nova-compute[71026]:   <serial>701e538c-71d5-4f4c-9858-0d851bd9181e</serial>
Jul 27 16:43:39 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:43:39 user nova-compute[71026]: </disk>
Jul 27 16:43:39 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:43:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Successfully detached device vdb from instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 from the persistent domain config.
Jul 27 16:43:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:43:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:43:39 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:43:39 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:43:39 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:43:39 user nova-compute[71026]:   <serial>701e538c-71d5-4f4c-9858-0d851bd9181e</serial>
Jul 27 16:43:39 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:43:39 user nova-compute[71026]: </disk>
Jul 27 16:43:39 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476220.0306468, a5c6cc55-aab2-4594-ba5a-1aef54b50a79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:43:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Successfully detached device vdb from instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 from the live domain config.
Jul 27 16:43:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEQOBuxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:43:40 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51962f9-1ac6-4257-b177-cb6372a3af9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:43:40 user nova-compute[71026]: No targets found.
Jul 27 16:43:40 user nova-compute[71026]: iSNS:
Jul 27 16:43:40 user nova-compute[71026]: No targets found.
Jul 27 16:43:40 user nova-compute[71026]: STATIC:
Jul 27 16:43:40 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1
Jul 27 16:43:40 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:40 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:40 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e
Jul 27 16:43:40 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:43:40 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:43:40 user nova-compute[71026]: FIRMWARE:
Jul 27 16:43:40 user nova-compute[71026]: No targets found.
Jul 27 16:43:40 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:43:40 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:43:40 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c77dccc-0a57-4f26-a809-ba675ac3bbc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a411089-bbfe-4873-949a-d92fa5012536]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:40 user nova-compute[71026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)
Jul 27 16:43:40 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:43:40 user nova-compute[71026]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e (non-flash)
Jul 27 16:43:40 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885428c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddaf028-612d-445c-87c0-00e0d5ea63f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5ec8b-b61a-4c51-b15e-18829f02fc96]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b06ddb-fc95-4f1c-a104-5102055f7a79]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a485f-2dc1-4baf-9a36-4eef66781a71]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ae75df-34b4-40e6-99f3-7c6d4b592cc9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2077bac-5998-4822-b5a0-3c95d70de31b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260]
Jul 27 16:43:40 user nova-compute[71026]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e, portal: 172.16.0.220,3260] successful.
Jul 27 16:43:40 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:701e538c-71d5-4f4c-9858-0d851bd9181e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ccc93a-c679-40f5-8fde-af6923611dd8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] <== disconnect_volume: return (292ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:43:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:43:41 user nova-compute[71026]: DEBUG nova.objects.instance [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'flavor' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:43:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-95152315-1aff-4a0f-8ca1-403a2d0a29cf tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.686s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:43:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:43:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:44:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:44:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-changed-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Refreshing instance network info cache due to event network-changed-e396e883-942f-4131-bcbb-32e5cc866b74. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:44:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] Acquiring lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] Acquired lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:08 user nova-compute[71026]: DEBUG nova.network.neutron [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Refreshing network info cache for port e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:44:09 user nova-compute[71026]: DEBUG nova.network.neutron [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updated VIF entry in instance network info cache for port e396e883-942f-4131-bcbb-32e5cc866b74. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:44:09 user nova-compute[71026]: DEBUG nova.network.neutron [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updating instance_info_cache with network_info: [{"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c91bcbba-46bb-450e-9804-a779ed5dc018 req-0794ba38-c7cf-4731-a499-2d2dcc76710a service nova] Releasing lock "refresh_cache-7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:15 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:16 user nova-compute[71026]: INFO nova.compute.manager [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Terminating instance
Jul 27 16:44:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-unplugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] No waiting events found dispatching network-vif-unplugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-b59ca1ab-8650-423c-beb1-9d25602ec7df req-5739a292-d9dd-45c7-aa50-c4fb3a86810d service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-unplugged-1c085f61-f6ff-4884-baab-101092898a1a for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:44:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Instance destroyed successfully.
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lazy-loading 'resources' on Instance uuid e6154c2b-855a-4baf-b3e0-e1dee76110b7 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1071598303',display_name='tempest-SnapshotDataIntegrityTests-server-1071598303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1071598303',id=13,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4wGkxZUU42gP9ZD3LsxJAyuoLsX8Cv8S23sxBR98U7w6dP2zla0kxW3o3Y6MRU4QeCaWo+5fqMTOsYfjkeRbnRl5yCmZU1LvwYDOx50f8pB81HXsQ9WsHJ3o/5KdeNTw==',key_name='tempest-keypair-1865012223',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:37:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f47223aec7b4b5aae9d48c87258be18',ramdisk_id='',reservation_id='r-ufdxr0u6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1287739161',owner_user_name='tempest-SnapshotDataIntegrityTests-1287739161-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76eb24d0cfe34fe3915c2f23b4b367ae',uuid=e6154c2b-855a-4baf-b3e0-e1dee76110b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converting VIF {"id": "1c085f61-f6ff-4884-baab-101092898a1a", "address": "fa:16:3e:70:6e:3a", "network": {"id": "a9469019-2df5-4747-bcb5-716aa903f7f5", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-645627288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f47223aec7b4b5aae9d48c87258be18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c085f61-f6", "ovs_interfaceid": "1c085f61-f6ff-4884-baab-101092898a1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG os_vif [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c085f61-f6, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:17 user nova-compute[71026]: INFO os_vif [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:6e:3a,bridge_name='br-int',has_traffic_filtering=True,id=1c085f61-f6ff-4884-baab-101092898a1a,network=Network(a9469019-2df5-4747-bcb5-716aa903f7f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c085f61-f6')
Jul 27 16:44:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Deleting instance files /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7_del
Jul 27 16:44:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Deletion of /opt/stack/data/nova/instances/e6154c2b-855a-4baf-b3e0-e1dee76110b7_del complete
Jul 27 16:44:17 user nova-compute[71026]: INFO nova.compute.manager [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] Acquiring lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] No waiting events found dispatching network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:19 user nova-compute[71026]: WARNING nova.compute.manager [req-7168225f-2797-49e9-9f52-a41c4f740599 req-aabfd020-1b4a-4520-b43b-7671d969fbc6 service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received unexpected event network-vif-plugged-1c085f61-f6ff-4884-baab-101092898a1a for instance with vm_state active and task_state deleting.
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:20 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Took 2.48 seconds to deallocate network for instance.
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid 'e6154c2b-855a-4baf-b3e0-e1dee76110b7' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e6154c2b-855a-4baf-b3e0-e1dee76110b7' (instance-0000000d)
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.705825805664062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.936s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.214s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:21 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Deleted allocations for instance e6154c2b-855a-4baf-b3e0-e1dee76110b7
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9a91b0b3-386b-40c8-b067-48c2c8d5cdff tempest-SnapshotDataIntegrityTests-1287739161 tempest-SnapshotDataIntegrityTests-1287739161-project-member] Lock "e6154c2b-855a-4baf-b3e0-e1dee76110b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.609s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dae8f77e-2791-48e6-8803-d0660647ab18 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1735}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-865e7d45-92bc-42cb-aeb2-7395036ead39 req-775e440c-a777-456a-b2f2-723513d383da service nova] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Received event network-vif-deleted-1c085f61-f6ff-4884-baab-101092898a1a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.459s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:44:21 user nova-compute[71026]: INFO nova.compute.claims [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Claim successful on node user
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:44:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:44:22 user nova-compute[71026]: INFO nova.virt.block_device [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Booting with volume 3b5788d5-58d3-42cd-a6a0-16786e351a09 at /dev/vda
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d44646-1fcb-4e1f-ade5-612bcec3d2fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.policy [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '072754b24f114dea8b70d8ce6370d7e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dac247d812f44c28c003f764b784304', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c0f991-2fec-44f9-85bd-556d8ee2ace6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ea235-fb03-4cd9-b265-8d7ddb0198ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae095b43-1e88-40ac-9e7d-0f83d1db142b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:22 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60363713-b8dd-4d80-b20d-8795ae722b7d]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating existing volume attachment record: 3ed80230-2ab3-4849-9ee7-b6884a222c8d {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Successfully created port: b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:44:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Successfully updated port: b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquired lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-changed-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Refreshing instance network info cache due to event network-changed-b1953529-8ca6-4160-9163-410e682544d9. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] Acquiring lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating instance_info_cache with network_info: [{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Releasing lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance network_info: |[{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] Acquired lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:26 user nova-compute[71026]: DEBUG nova.network.neutron [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Refreshing network info cache for port b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updated VIF entry in instance network info cache for port b1953529-8ca6-4160-9163-410e682544d9. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating instance_info_cache with network_info: [{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09664e4c-3b4a-4708-826c-308886dfddac req-00166740-18f0-46ad-951d-5286dd3642e0 service nova] Releasing lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:44:27 user nova-compute[71026]: INFO nova.compute.claims [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Claim successful on node user
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:44:28 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:44:28 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Creating image(s)
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.policy [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c543c6c138ad482ca985d5a756f78334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a20fd76c514ce488f9467e5ec36012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk 1073741824" returned: 0 in 0.054s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Cannot resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.objects.instance [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'migration_context' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Ensure instance console log exists: /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:44:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Successfully created port: d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:44:30 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Creating image(s)
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Ensure instance console log exists: /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start _get_guest_xml network_info=[{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3ed80230-2ab3-4849-9ee7-b6884a222c8d', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dae8f77e-2791-48e6-8803-d0660647ab18', 'attached_at': '', 'detached_at': '', 'volume_id': '3b5788d5-58d3-42cd-a6a0-16786e351a09', 'serial': '3b5788d5-58d3-42cd-a6a0-16786e351a09'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:44:30 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:30 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:30 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:30 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:30 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cc1438-0570-456f-a200-6b5bea670167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:44:30 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ca969-f3bb-45e0-b5cf-4934ba9e3dbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09] added
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0872b4-71aa-432e-8ddf-904cd62cd989]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b64fe7-2760-47eb-9dd3-c7a090bddc64]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSkdcDHr {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSkdcDHr" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5441399-604b-4adc-9fcd-f60e3554e076]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSkdcDHr'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07364e4-4d65-4dfb-a6a1-61498475db59]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d750637-5535-4ab3-bdc5-3d7abe721053]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Successfully updated port: d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e87b81-5cbd-460b-9e05-e9256613fa43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]
Jul 27 16:44:30 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-changed-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Refreshing instance network info cache due to event network-changed-d4d5e45c-b26e-492f-9a92-f0bc0c120325. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6901cd56-3d65-4f82-bb67-a6abdadcdfb9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3cdff0-7f95-4ac1-9441-65c87da04156]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[116d7b4b-849d-4e52-afef-6e4e24296138]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:44:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance network_info: |[{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Refreshing network info cache for port d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start _get_guest_xml network_info=[{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:44:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'pci_devices' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:44:31 user nova-compute[71026]:   <uuid>95dcc9cc-42b0-413a-acd8-921a1197c8d9</uuid>
Jul 27 16:44:31 user nova-compute[71026]:   <name>instance-00000016</name>
Jul 27 16:44:31 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:44:31 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:44:31 user nova-compute[71026]:   <metadata>
Jul 27 16:44:31 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:44:31 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeTestJSON-server-904067667</nova:name>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:44:31</nova:creationTime>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:44:31 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:44:31 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:owner>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:user uuid="c543c6c138ad482ca985d5a756f78334">tempest-AttachVolumeTestJSON-2013998243-project-member</nova:user>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:project uuid="c4a20fd76c514ce488f9467e5ec36012">tempest-AttachVolumeTestJSON-2013998243</nova:project>
Jul 27 16:44:31 user nova-compute[71026]:       </nova:owner>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:44:31 user nova-compute[71026]:       <nova:ports>
Jul 27 16:44:31 user nova-compute[71026]:         <nova:port uuid="d4d5e45c-b26e-492f-9a92-f0bc0c120325">
Jul 27 16:44:31 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 16:44:31 user nova-compute[71026]:         </nova:port>
Jul 27 16:44:31 user nova-compute[71026]:       </nova:ports>
Jul 27 16:44:31 user nova-compute[71026]:     </nova:instance>
Jul 27 16:44:31 user nova-compute[71026]:   </metadata>
Jul 27 16:44:31 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:44:31 user nova-compute[71026]:     <system>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="serial">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="uuid">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:44:31 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:44:31 user nova-compute[71026]:     </system>
Jul 27 16:44:31 user nova-compute[71026]:   </sysinfo>
Jul 27 16:44:31 user nova-compute[71026]:   <os>
Jul 27 16:44:31 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:44:31 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:44:31 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:44:31 user nova-compute[71026]:   </os>
Jul 27 16:44:31 user nova-compute[71026]:   <features>
Jul 27 16:44:31 user nova-compute[71026]:     <acpi/>
Jul 27 16:44:31 user nova-compute[71026]:     <apic/>
Jul 27 16:44:31 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:44:31 user nova-compute[71026]:   </features>
Jul 27 16:44:31 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:44:31 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:44:31 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:44:31 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:44:31 user nova-compute[71026]:   </clock>
Jul 27 16:44:31 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:44:31 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:44:31 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:44:31 user nova-compute[71026]:   </cpu>
Jul 27 16:44:31 user nova-compute[71026]:   <devices>
Jul 27 16:44:31 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:44:31 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:44:31 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk"/>
Jul 27 16:44:31 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:44:31 user nova-compute[71026]:     </disk>
Jul 27 16:44:31 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:44:31 user nova-compute[71026]:       <mac address="fa:16:3e:92:e9:89"/>
Jul 27 16:44:31 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:31 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:44:31 user nova-compute[71026]:       <target dev="tapd4d5e45c-b2"/>
Jul 27 16:44:31 user nova-compute[71026]:     </interface>
Jul 27 16:44:31 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:44:31 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/console.log" append="off"/>
Jul 27 16:44:31 user nova-compute[71026]:     </serial>
Jul 27 16:44:31 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:44:31 user nova-compute[71026]:     <video>
Jul 27 16:44:31 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:31 user nova-compute[71026]:     </video>
Jul 27 16:44:31 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:44:31 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:44:31 user nova-compute[71026]:     </rng>
Jul 27 16:44:31 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:44:31 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:44:31 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:44:31 user nova-compute[71026]:     </memballoon>
Jul 27 16:44:31 user nova-compute[71026]:   </devices>
Jul 27 16:44:31 user nova-compute[71026]: </domain>
Jul 27 16:44:31 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG os_vif [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d5e45c-b2, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d5e45c-b2, col_values=(('external_ids', {'iface-id': 'd4d5e45c-b26e-492f-9a92-f0bc0c120325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e9:89', 'vm-uuid': '95dcc9cc-42b0-413a-acd8-921a1197c8d9'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:31 user nova-compute[71026]: INFO os_vif [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No VIF found with MAC fa:16:3e:92:e9:89, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26264626164376464', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:44:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626164376464', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1044947004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.objects.instance [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'pci_devices' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:44:32 user nova-compute[71026]:   <uuid>dae8f77e-2791-48e6-8803-d0660647ab18</uuid>
Jul 27 16:44:32 user nova-compute[71026]:   <name>instance-00000015</name>
Jul 27 16:44:32 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:44:32 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:44:32 user nova-compute[71026]:   <metadata>
Jul 27 16:44:32 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:44:32 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:44:32 user nova-compute[71026]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1044947004</nova:name>
Jul 27 16:44:32 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:44:30</nova:creationTime>
Jul 27 16:44:32 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:44:32 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:44:32 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:44:32 user nova-compute[71026]:       <nova:owner>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:user uuid="072754b24f114dea8b70d8ce6370d7e3">tempest-ServerActionsV293TestJSON-510559864-project-member</nova:user>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:project uuid="0dac247d812f44c28c003f764b784304">tempest-ServerActionsV293TestJSON-510559864</nova:project>
Jul 27 16:44:32 user nova-compute[71026]:       </nova:owner>
Jul 27 16:44:32 user nova-compute[71026]:       <nova:ports>
Jul 27 16:44:32 user nova-compute[71026]:         <nova:port uuid="b1953529-8ca6-4160-9163-410e682544d9">
Jul 27 16:44:32 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:44:32 user nova-compute[71026]:         </nova:port>
Jul 27 16:44:32 user nova-compute[71026]:       </nova:ports>
Jul 27 16:44:32 user nova-compute[71026]:     </nova:instance>
Jul 27 16:44:32 user nova-compute[71026]:   </metadata>
Jul 27 16:44:32 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:44:32 user nova-compute[71026]:     <system>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="serial">dae8f77e-2791-48e6-8803-d0660647ab18</entry>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="uuid">dae8f77e-2791-48e6-8803-d0660647ab18</entry>
Jul 27 16:44:32 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:44:32 user nova-compute[71026]:     </system>
Jul 27 16:44:32 user nova-compute[71026]:   </sysinfo>
Jul 27 16:44:32 user nova-compute[71026]:   <os>
Jul 27 16:44:32 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:44:32 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:44:32 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:44:32 user nova-compute[71026]:   </os>
Jul 27 16:44:32 user nova-compute[71026]:   <features>
Jul 27 16:44:32 user nova-compute[71026]:     <acpi/>
Jul 27 16:44:32 user nova-compute[71026]:     <apic/>
Jul 27 16:44:32 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:44:32 user nova-compute[71026]:   </features>
Jul 27 16:44:32 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:44:32 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:44:32 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:44:32 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:44:32 user nova-compute[71026]:   </clock>
Jul 27 16:44:32 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:44:32 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:44:32 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:44:32 user nova-compute[71026]:   </cpu>
Jul 27 16:44:32 user nova-compute[71026]:   <devices>
Jul 27 16:44:32 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:44:32 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:44:32 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:44:32 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:44:32 user nova-compute[71026]:       <serial>3b5788d5-58d3-42cd-a6a0-16786e351a09</serial>
Jul 27 16:44:32 user nova-compute[71026]:     </disk>
Jul 27 16:44:32 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:44:32 user nova-compute[71026]:       <mac address="fa:16:3e:73:27:be"/>
Jul 27 16:44:32 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:32 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:44:32 user nova-compute[71026]:       <target dev="tapb1953529-8c"/>
Jul 27 16:44:32 user nova-compute[71026]:     </interface>
Jul 27 16:44:32 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:44:32 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18/console.log" append="off"/>
Jul 27 16:44:32 user nova-compute[71026]:     </serial>
Jul 27 16:44:32 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:44:32 user nova-compute[71026]:     <video>
Jul 27 16:44:32 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:32 user nova-compute[71026]:     </video>
Jul 27 16:44:32 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:44:32 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:44:32 user nova-compute[71026]:     </rng>
Jul 27 16:44:32 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:44:32 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:44:32 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:44:32 user nova-compute[71026]:     </memballoon>
Jul 27 16:44:32 user nova-compute[71026]:   </devices>
Jul 27 16:44:32 user nova-compute[71026]: </domain>
Jul 27 16:44:32 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1044947004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG os_vif [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1953529-8c, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1953529-8c, col_values=(('external_ids', {'iface-id': 'b1953529-8ca6-4160-9163-410e682544d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:27:be', 'vm-uuid': 'dae8f77e-2791-48e6-8803-d0660647ab18'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:32 user nova-compute[71026]: INFO os_vif [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c')
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No VIF found with MAC fa:16:3e:73:27:be, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updated VIF entry in instance network info cache for port d4d5e45c-b26e-492f-9a92-f0bc0c120325. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2fad7ce-3894-48dd-84ea-3e7873591a20 req-714db8d3-fb3a-49aa-941f-a9a804678dec service nova] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476257.4938514, e6154c2b-855a-4baf-b3e0-e1dee76110b7 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:32 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] VM Stopped (Lifecycle Event)
Jul 27 16:44:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e67e1ea2-58c0-403d-80cf-4250be5a1e97 None None] [instance: e6154c2b-855a-4baf-b3e0-e1dee76110b7] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:34 user nova-compute[71026]: WARNING nova.compute.manager [req-ffbf9746-38d2-4641-bd41-c4c06c869c8e req-6903cead-0013-479b-9a3f-2e271e3c12fd service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state building and task_state spawning.
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:34 user nova-compute[71026]: WARNING nova.compute.manager [req-ce3d745b-fbba-4732-a109-01e6ead8541f req-47eef2c3-8ee5-4c43-8cfe-a45a28072047 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state building and task_state spawning.
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:35 user nova-compute[71026]: INFO nova.compute.manager [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Terminating instance
Jul 27 16:44:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-unplugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] No waiting events found dispatching network-vif-unplugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-8404a12c-c885-42ef-8842-7c8b71a0c43d req-5eb91742-c608-48a6-9aaf-86773dffa0d8 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-unplugged-eccba2a6-423a-428b-a59c-377a2aabcb9b for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:44:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Instance destroyed successfully.
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lazy-loading 'resources' on Instance uuid a5c6cc55-aab2-4594-ba5a-1aef54b50a79 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643344690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6433446',id=18,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJJG+XuxlLUjKQ1XTRZMkyijpcvgHAFW8LCMfnw6CtvJzxMOxsbP15W5ArIVCGSu2IFjSaH1b/H0b4S1y2arpLZJSlBdm3ro2DdDFWb1n5k0o2wxO/XZHqlcXvOvnYN7g==',key_name='tempest-keypair-1443763841',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:41:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d6890027dbc4f5bba2f52e1c6db058d',ramdisk_id='',reservation_id='r-6t4vxcib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffab398326e24e2e9f455e7fde6277e3',uuid=a5c6cc55-aab2-4594-ba5a-1aef54b50a79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converting VIF {"id": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "address": "fa:16:3e:45:99:6a", "network": {"id": "41a886e2-78c2-463f-980f-146a04860c49", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1039647495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6890027dbc4f5bba2f52e1c6db058d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeccba2a6-42", "ovs_interfaceid": "eccba2a6-423a-428b-a59c-377a2aabcb9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG os_vif [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeccba2a6-42, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:36 user nova-compute[71026]: INFO os_vif [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:99:6a,bridge_name='br-int',has_traffic_filtering=True,id=eccba2a6-423a-428b-a59c-377a2aabcb9b,network=Network(41a886e2-78c2-463f-980f-146a04860c49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeccba2a6-42')
Jul 27 16:44:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Deleting instance files /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79_del
Jul 27 16:44:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Deletion of /opt/stack/data/nova/instances/a5c6cc55-aab2-4594-ba5a-1aef54b50a79_del complete
Jul 27 16:44:36 user nova-compute[71026]: INFO nova.compute.manager [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:36 user nova-compute[71026]: WARNING nova.compute.manager [req-103ffc40-b1de-4d07-9f5a-0e4a21057cdc req-b9470713-210d-47c1-9b53-adf9b97631b7 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state building and task_state spawning.
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:36 user nova-compute[71026]: WARNING nova.compute.manager [req-7f229b95-cb35-4632-8a20-407877228a0c req-19896af7-672c-4b47-ac4d-9603aec38402 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state building and task_state spawning.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476277.517805, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Resumed (Lifecycle Event)
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance spawned successfully.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476277.5202835, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Started (Lifecycle Event)
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476277.6731045, dae8f77e-2791-48e6-8803-d0660647ab18 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Resumed (Lifecycle Event)
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance spawned successfully.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Took 9.48 seconds to spawn the instance on the hypervisor.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476277.6748252, dae8f77e-2791-48e6-8803-d0660647ab18 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Started (Lifecycle Event)
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Took 10.42 seconds to build instance.
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Took 7.41 seconds to spawn the instance on the hypervisor.
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-543ea377-66db-43a9-9936-0cc19d67be43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.540s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:37 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:37 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Took 1.47 seconds to deallocate network for instance.
Jul 27 16:44:38 user nova-compute[71026]: INFO nova.compute.manager [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Took 16.99 seconds to build instance.
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] Acquiring lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] No waiting events found dispatching network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:38 user nova-compute[71026]: WARNING nova.compute.manager [req-976a7342-abe0-4640-8161-90f18ee7ebb4 req-6d0dec1c-01ea-4447-adcf-79c75b5e5611 service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received unexpected event network-vif-plugged-eccba2a6-423a-428b-a59c-377a2aabcb9b for instance with vm_state deleted and task_state None.
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43c989e2-3fe3-47f1-bd7e-147859494263 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.105s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:38 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Deleted allocations for instance a5c6cc55-aab2-4594-ba5a-1aef54b50a79
Jul 27 16:44:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8776d26f-2dfa-4463-8f36-df1b1dbb706b tempest-TestServerVolumeAttachScenarioOldVersion-848109580 tempest-TestServerVolumeAttachScenarioOldVersion-848109580-project-member] Lock "a5c6cc55-aab2-4594-ba5a-1aef54b50a79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.132s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-922ffa9e-9621-473b-a6fb-31e3079e88a0 req-d8b64428-b6b3-464e-981a-4e1f72d5715d service nova] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Received event network-vif-deleted-eccba2a6-423a-428b-a59c-377a2aabcb9b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:40 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:44:40 user nova-compute[71026]: INFO nova.compute.claims [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Claim successful on node user
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:44:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:44:41 user nova-compute[71026]: INFO nova.virt.block_device [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Booting with volume 37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 at /dev/vda
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.policy [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65274ecb1cb84995a5ab9d43e315ac2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d01c4091154135a4fab0a817e406c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.utils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead3e04-5778-4897-85e1-3c4010151439]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66844921-fbb6-487b-b875-ba8a646a4ff2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8120909b-3f26-4d02-bb32-ae11238fc914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bece96-f997-462f-94eb-73e1fdfb0a41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:41 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:44:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[451aecfd-8f79-47ad-a8c3-dd34ffb2d7ba]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG os_brick.utils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:44:41 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating existing volume attachment record: d4ce9f70-5d9b-4ddb-8818-50ba5976e36b {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Successfully created port: 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Successfully updated port: 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing instance network info cache due to event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:44:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance network_info: |[{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updated VIF entry in instance network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-658c782e-132c-4b6e-963b-41269728fa8d req-b186e2e0-17cf-477b-a884-4988600eb684 service nova] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:44:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Creating image(s)
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Ensure instance console log exists: /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start _get_guest_xml network_info=[{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd4ce9f70-5d9b-4ddb-8818-50ba5976e36b', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1', 'attached_at': '', 'detached_at': '', 'volume_id': '37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'serial': '37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:44:49 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:49 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:49 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:49 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:49 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501368d-e999-4d1c-94ca-51c10aaab6e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:44:49 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9452f738-a337-4c3a-b687-499ba35f1896]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312] added
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042f7ef-35d5-45ef-8941-a3e1630822dc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48581dfc-0e27-4150-8e27-da3fcd38c712]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDJbanSk {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDJbanSk" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116f892-64e4-4402-ace2-825ef54ccf62]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDJbanSk'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1908b-f861-4df6-adc6-ef44490b02ad]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca54112-b200-473f-a3e0-977f91f960a9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a99517-369b-4b7f-a9d5-a5567093a1d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]
Jul 27 16:44:49 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579f30d-8452-41a8-a46e-677d882164eb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3a46c-ca04-49a9-8d84-07a7193031dc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:44:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f3f76-2793-456d-a4d6-20a720dda031]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:44:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23139666639646637', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139666639646637', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTdxKL7iEwgys02p15YUAFpKg4miLcztjkjASObzm9oJItTISnaWlEnZp4YSKUkoYfuloTYK5R+0f8ddEbTV7HusTnRKkgwdeEJMxrnts6YZFBuLVnOK/xby7KGXDk6Sg==',key_name='tempest-TestShelveInstance-1110890233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:41Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:44:51 user nova-compute[71026]:   <uuid>56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</uuid>
Jul 27 16:44:51 user nova-compute[71026]:   <name>instance-00000017</name>
Jul 27 16:44:51 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:44:51 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:44:51 user nova-compute[71026]:   <metadata>
Jul 27 16:44:51 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:44:51 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:44:51 user nova-compute[71026]:       <nova:name>tempest-TestShelveInstance-server-893891946</nova:name>
Jul 27 16:44:51 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:44:49</nova:creationTime>
Jul 27 16:44:51 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:44:51 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:44:51 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:44:51 user nova-compute[71026]:       <nova:owner>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:user uuid="65274ecb1cb84995a5ab9d43e315ac2a">tempest-TestShelveInstance-697106287-project-member</nova:user>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:project uuid="e3d01c4091154135a4fab0a817e406c3">tempest-TestShelveInstance-697106287</nova:project>
Jul 27 16:44:51 user nova-compute[71026]:       </nova:owner>
Jul 27 16:44:51 user nova-compute[71026]:       <nova:ports>
Jul 27 16:44:51 user nova-compute[71026]:         <nova:port uuid="42e5797d-04b4-454d-98de-385c51ca70f2">
Jul 27 16:44:51 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:44:51 user nova-compute[71026]:         </nova:port>
Jul 27 16:44:51 user nova-compute[71026]:       </nova:ports>
Jul 27 16:44:51 user nova-compute[71026]:     </nova:instance>
Jul 27 16:44:51 user nova-compute[71026]:   </metadata>
Jul 27 16:44:51 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:44:51 user nova-compute[71026]:     <system>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="serial">56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</entry>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="uuid">56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</entry>
Jul 27 16:44:51 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:44:51 user nova-compute[71026]:     </system>
Jul 27 16:44:51 user nova-compute[71026]:   </sysinfo>
Jul 27 16:44:51 user nova-compute[71026]:   <os>
Jul 27 16:44:51 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:44:51 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:44:51 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:44:51 user nova-compute[71026]:   </os>
Jul 27 16:44:51 user nova-compute[71026]:   <features>
Jul 27 16:44:51 user nova-compute[71026]:     <acpi/>
Jul 27 16:44:51 user nova-compute[71026]:     <apic/>
Jul 27 16:44:51 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:44:51 user nova-compute[71026]:   </features>
Jul 27 16:44:51 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:44:51 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:44:51 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:44:51 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:44:51 user nova-compute[71026]:   </clock>
Jul 27 16:44:51 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:44:51 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:44:51 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:44:51 user nova-compute[71026]:   </cpu>
Jul 27 16:44:51 user nova-compute[71026]:   <devices>
Jul 27 16:44:51 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:44:51 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:44:51 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:44:51 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:44:51 user nova-compute[71026]:       <serial>37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312</serial>
Jul 27 16:44:51 user nova-compute[71026]:     </disk>
Jul 27 16:44:51 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:44:51 user nova-compute[71026]:       <mac address="fa:16:3e:74:c4:81"/>
Jul 27 16:44:51 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:51 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:44:51 user nova-compute[71026]:       <target dev="tap42e5797d-04"/>
Jul 27 16:44:51 user nova-compute[71026]:     </interface>
Jul 27 16:44:51 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:44:51 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1/console.log" append="off"/>
Jul 27 16:44:51 user nova-compute[71026]:     </serial>
Jul 27 16:44:51 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:44:51 user nova-compute[71026]:     <video>
Jul 27 16:44:51 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:44:51 user nova-compute[71026]:     </video>
Jul 27 16:44:51 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:44:51 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:44:51 user nova-compute[71026]:     </rng>
Jul 27 16:44:51 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:44:51 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:44:51 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:44:51 user nova-compute[71026]:     </memballoon>
Jul 27 16:44:51 user nova-compute[71026]:   </devices>
Jul 27 16:44:51 user nova-compute[71026]: </domain>
Jul 27 16:44:51 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTdxKL7iEwgys02p15YUAFpKg4miLcztjkjASObzm9oJItTISnaWlEnZp4YSKUkoYfuloTYK5R+0f8ddEbTV7HusTnRKkgwdeEJMxrnts6YZFBuLVnOK/xby7KGXDk6Sg==',key_name='tempest-TestShelveInstance-1110890233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:44:41Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG os_vif [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42e5797d-04, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42e5797d-04, col_values=(('external_ids', {'iface-id': '42e5797d-04b4-454d-98de-385c51ca70f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c4:81', 'vm-uuid': '56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:51 user nova-compute[71026]: INFO os_vif [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04')
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] No VIF found with MAC fa:16:3e:74:c4:81, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476276.3428288, a5c6cc55-aab2-4594-ba5a-1aef54b50a79 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:51 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] VM Stopped (Lifecycle Event)
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-350cb21b-3234-4989-b38b-bfc391beffa3 None None] [instance: a5c6cc55-aab2-4594-ba5a-1aef54b50a79] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing instance network info cache due to event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'flavor' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:52 user nova-compute[71026]: INFO nova.compute.manager [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Attaching volume a340af56-ef04-45a3-92ac-6d7d37ecd4d4 to /dev/vdb
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.utils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0412a8-9bde-4ab9-93bc-5f4d1881c34d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2028898-8b0d-487f-8fb6-367c6171b5ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53129a9-1422-4ec4-a883-16aa41c89545]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906b5c5-8dc3-4ed4-8a4d-6b51e2631c1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:44:52 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[490113d0-a69b-4c05-be74-c3aa5d3b5fba]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG os_brick.utils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating existing volume attachment record: b895cd3c-ff79-4163-9550-61451f500dee {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updated VIF entry in instance network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d273234f-a043-4f1d-9565-9c7893163d44 req-0848f475-15bc-455b-af1e-6b8b6fe6b849 service nova] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:52 user nova-compute[71026]: WARNING nova.compute.manager [req-73255c6f-d4af-474c-9c51-09df09c06307 req-2b25ea71-6463-4709-95d2-1a2539e1ae24 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state building and task_state spawning.
Jul 27 16:44:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476294.894074, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Resumed (Lifecycle Event)
Jul 27 16:44:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance spawned successfully.
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:44:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476294.8943214, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:44:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Started (Lifecycle Event)
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:44:54 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:44:55 user nova-compute[71026]: INFO nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Took 5.54 seconds to spawn the instance on the hypervisor.
Jul 27 16:44:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:44:55 user nova-compute[71026]: INFO nova.compute.manager [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Took 14.41 seconds to build instance.
Jul 27 16:44:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1252b905-b72d-41ed-a4d9-47e261b4102c tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.532s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:44:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:44:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:44:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:44:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:44:55 user nova-compute[71026]: WARNING nova.compute.manager [req-13105f9d-0cfa-44a7-b375-37178a44e7a4 req-356b8b63-be0b-4961-bde3-a329ce22c3cb service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state active and task_state None.
Jul 27 16:44:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuaOfBmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:44:59 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:59 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:44:59 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fad26c-d879-4ed4-9a75-86459d3cd29d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:44:59 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d682ef69-0d62-4365-b865-b5f0de29f639]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4] added
Jul 27 16:44:59 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bb6fad-45cf-45d6-867c-4ed9c8a5d374]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaaa4d5-04ce-4079-baae-c36da469a63c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:44:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuaOfBmj {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuaOfBmj" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d26f553-a203-4fe7-83e4-53fd1fbef5cd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuaOfBmj'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc80f2e-bf72-46ff-9d31-90ef2a2217f4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab1a03-7d94-4a1c-bf08-1e13a8ae548c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a05ac8-284e-4b8f-bf1a-d9ec14be08df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260]
Jul 27 16:45:00 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260] successful.
Jul 27 16:45:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7bcb2b-170b-45bd-b000-2510d23e45fd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ea7f8-8aba-4c8b-b4a9-223f480de32b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:45:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efbd35-22fb-4bae-8dd1-7e8b857d84ff]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:45:00 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuaOfBmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23135326337363330', 'path': '/dev/sde'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135326337363330', 'path': '/dev/sde'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'flavor' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:45:01 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:45:01 user nova-compute[71026]:   <source dev="/dev/sde"/>
Jul 27 16:45:01 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:45:01 user nova-compute[71026]:   <serial>a340af56-ef04-45a3-92ac-6d7d37ecd4d4</serial>
Jul 27 16:45:01 user nova-compute[71026]: </disk>
Jul 27 16:45:01 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:2b:2b:8e, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:45:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76eeef82-0389-46fa-8637-4909f92dfe06 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.628s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:02 user nova-compute[71026]: INFO nova.compute.manager [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Rescuing
Jul 27 16:45:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:45:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:45:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:03 user nova-compute[71026]: WARNING nova.compute.manager [req-db21a878-4558-4483-8295-b288050de9c1 req-bd4c9662-4928-42c8-81e8-99ea8c50c4a4 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state active and task_state rescuing.
Jul 27 16:45:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance destroyed successfully.
Jul 27 16:45:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Attempting rescue
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:45:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Creating image(s)
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue" returned: 0 in 0.048s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'migration_context' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start _get_guest_xml network_info=[{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:2b:2b:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'numa_topology' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:04 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-244159089',display_name='tempest-ServerRescueNegativeTestJSON-server-244159089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-244159089',id=20,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbVZbxraV9LLAYbitENvm7qE5uy+asL3RJ5zJAybGKiBTF8Cdyko5Af5r0bkNToPHY27EbQT7Kx7HbEjndoXMvYFbm0Z4E7mhy1JznNARq3v1wSjZFDVJ/NWdB1AypIPA==',key_name='tempest-keypair-1386888906',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-f67li0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421dd87102724509a506e368de55faaf',uuid=3550a85d-ed4d-4728-8398-23a171e6f40d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:2b:2b:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "vif_mac": "fa:16:3e:2b:2b:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'pci_devices' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:45:04 user nova-compute[71026]:   <uuid>3550a85d-ed4d-4728-8398-23a171e6f40d</uuid>
Jul 27 16:45:04 user nova-compute[71026]:   <name>instance-00000014</name>
Jul 27 16:45:04 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:45:04 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:45:04 user nova-compute[71026]:   <metadata>
Jul 27 16:45:04 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:45:04 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-244159089</nova:name>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:45:04</nova:creationTime>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:45:04 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:45:04 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:owner>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:user uuid="421dd87102724509a506e368de55faaf">tempest-ServerRescueNegativeTestJSON-882048111-project-member</nova:user>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:project uuid="6408faede31045a6a3a34304629caa4f">tempest-ServerRescueNegativeTestJSON-882048111</nova:project>
Jul 27 16:45:04 user nova-compute[71026]:       </nova:owner>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:45:04 user nova-compute[71026]:       <nova:ports>
Jul 27 16:45:04 user nova-compute[71026]:         <nova:port uuid="8f907dad-0ec6-4443-83df-f6a5ad7b811d">
Jul 27 16:45:04 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 27 16:45:04 user nova-compute[71026]:         </nova:port>
Jul 27 16:45:04 user nova-compute[71026]:       </nova:ports>
Jul 27 16:45:04 user nova-compute[71026]:     </nova:instance>
Jul 27 16:45:04 user nova-compute[71026]:   </metadata>
Jul 27 16:45:04 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:45:04 user nova-compute[71026]:     <system>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="serial">3550a85d-ed4d-4728-8398-23a171e6f40d</entry>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="uuid">3550a85d-ed4d-4728-8398-23a171e6f40d</entry>
Jul 27 16:45:04 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:45:04 user nova-compute[71026]:     </system>
Jul 27 16:45:04 user nova-compute[71026]:   </sysinfo>
Jul 27 16:45:04 user nova-compute[71026]:   <os>
Jul 27 16:45:04 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:45:04 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:45:04 user nova-compute[71026]:   </os>
Jul 27 16:45:04 user nova-compute[71026]:   <features>
Jul 27 16:45:04 user nova-compute[71026]:     <acpi/>
Jul 27 16:45:04 user nova-compute[71026]:     <apic/>
Jul 27 16:45:04 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:45:04 user nova-compute[71026]:   </features>
Jul 27 16:45:04 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:45:04 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:45:04 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:45:04 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:45:04 user nova-compute[71026]:   </clock>
Jul 27 16:45:04 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:45:04 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:45:04 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:45:04 user nova-compute[71026]:   </cpu>
Jul 27 16:45:04 user nova-compute[71026]:   <devices>
Jul 27 16:45:04 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:45:04 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:45:04 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue"/>
Jul 27 16:45:04 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:45:04 user nova-compute[71026]:     </disk>
Jul 27 16:45:04 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:45:04 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:45:04 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk"/>
Jul 27 16:45:04 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:45:04 user nova-compute[71026]:     </disk>
Jul 27 16:45:04 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:45:04 user nova-compute[71026]:       <mac address="fa:16:3e:2b:2b:8e"/>
Jul 27 16:45:04 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:45:04 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:45:04 user nova-compute[71026]:       <target dev="tap8f907dad-0e"/>
Jul 27 16:45:04 user nova-compute[71026]:     </interface>
Jul 27 16:45:04 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:45:04 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/console.log" append="off"/>
Jul 27 16:45:04 user nova-compute[71026]:     </serial>
Jul 27 16:45:04 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:45:04 user nova-compute[71026]:     <video>
Jul 27 16:45:04 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:45:04 user nova-compute[71026]:     </video>
Jul 27 16:45:04 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:45:04 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:45:04 user nova-compute[71026]:     </rng>
Jul 27 16:45:04 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:45:04 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:45:04 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:45:04 user nova-compute[71026]:     </memballoon>
Jul 27 16:45:04 user nova-compute[71026]:   </devices>
Jul 27 16:45:04 user nova-compute[71026]: </domain>
Jul 27 16:45:04 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:45:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance destroyed successfully.
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:45:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] No VIF found with MAC fa:16:3e:2b:2b:8e, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:45:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:05 user nova-compute[71026]: WARNING nova.compute.manager [req-5b203b75-5035-43dc-a4c8-e7570fc417c0 req-c7477cf1-9173-4d1a-9605-9b155c3b6b5b service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state active and task_state rescuing.
Jul 27 16:45:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:07 user nova-compute[71026]: WARNING nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state active and task_state rescuing.
Jul 27 16:45:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:07 user nova-compute[71026]: WARNING nova.compute.manager [req-6aab5ffb-b9ed-4072-987e-5841bd7acafd req-a9dfde5c-00f8-467a-8195-4309c5596bb2 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state active and task_state rescuing.
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 3550a85d-ed4d-4728-8398-23a171e6f40d due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476308.6026795, 3550a85d-ed4d-4728-8398-23a171e6f40d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:45:08 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Resumed (Lifecycle Event)
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a549ad0a-b5c4-4cf0-8d33-be26aacc6b2d tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:45:08 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476308.6074665, 3550a85d-ed4d-4728-8398-23a171e6f40d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:45:08 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Started (Lifecycle Event)
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:45:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:45:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7517MB free_disk=25.716163635253906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dae8f77e-2791-48e6-8803-d0660647ab18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:45:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:45:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:25 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 16:45:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:45:33 user nova-compute[71026]: INFO nova.compute.claims [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Claim successful on node user
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:45:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.policy [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdef212322604675b67d86e73ab0878a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '351160478929495bb63cb9c9ac562a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:45:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Creating image(s)
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "/opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "/opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk 1073741824" returned: 0 in 0.058s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Successfully created port: ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Cannot resize image /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'migration_context' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Ensure instance console log exists: /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Successfully updated port: ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquired lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-changed-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Refreshing instance network info cache due to event network-changed-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] Acquiring lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating instance_info_cache with network_info: [{"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Releasing lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Instance network_info: |[{"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] Acquired lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Refreshing network info cache for port ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Start _get_guest_xml network_info=[{"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:45:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-296855908',display_name='tempest-TestServerVolumeAttachmentScenario-server-296855908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-296855908',id=24,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx6UCK7J2te/k4rOnuGO7R0HwISeat6Wb32EW1nnNtCSvRtHcn4LYHzgAGykaBzy8SWxX//6e++0ZHUhApYQw72LJG3S046QluKOKHozCG7ifeKq6up5MHIBSAaUdB5mQ==',key_name='tempest-keypair-1063992593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='351160478929495bb63cb9c9ac562a72',ramdisk_id='',reservation_id='r-eeul353d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-224674346',owner_user_name='tempest-TestServerVolumeAttachmentScenario-224674346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef212322604675b67d86e73ab0878a',uuid=9c16cbdd-c74b-471f-acf9-232d88682f2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converting VIF {"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:45:35 user nova-compute[71026]:   <uuid>9c16cbdd-c74b-471f-acf9-232d88682f2e</uuid>
Jul 27 16:45:35 user nova-compute[71026]:   <name>instance-00000018</name>
Jul 27 16:45:35 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:45:35 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:45:35 user nova-compute[71026]:   <metadata>
Jul 27 16:45:35 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:45:35 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-296855908</nova:name>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:45:35</nova:creationTime>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:45:35 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:45:35 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:owner>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:user uuid="cdef212322604675b67d86e73ab0878a">tempest-TestServerVolumeAttachmentScenario-224674346-project-member</nova:user>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:project uuid="351160478929495bb63cb9c9ac562a72">tempest-TestServerVolumeAttachmentScenario-224674346</nova:project>
Jul 27 16:45:35 user nova-compute[71026]:       </nova:owner>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:45:35 user nova-compute[71026]:       <nova:ports>
Jul 27 16:45:35 user nova-compute[71026]:         <nova:port uuid="ddac2e8f-8e32-42aa-99b3-d8f1cbec145a">
Jul 27 16:45:35 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:45:35 user nova-compute[71026]:         </nova:port>
Jul 27 16:45:35 user nova-compute[71026]:       </nova:ports>
Jul 27 16:45:35 user nova-compute[71026]:     </nova:instance>
Jul 27 16:45:35 user nova-compute[71026]:   </metadata>
Jul 27 16:45:35 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:45:35 user nova-compute[71026]:     <system>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="serial">9c16cbdd-c74b-471f-acf9-232d88682f2e</entry>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="uuid">9c16cbdd-c74b-471f-acf9-232d88682f2e</entry>
Jul 27 16:45:35 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:45:35 user nova-compute[71026]:     </system>
Jul 27 16:45:35 user nova-compute[71026]:   </sysinfo>
Jul 27 16:45:35 user nova-compute[71026]:   <os>
Jul 27 16:45:35 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:45:35 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:45:35 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:45:35 user nova-compute[71026]:   </os>
Jul 27 16:45:35 user nova-compute[71026]:   <features>
Jul 27 16:45:35 user nova-compute[71026]:     <acpi/>
Jul 27 16:45:35 user nova-compute[71026]:     <apic/>
Jul 27 16:45:35 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:45:35 user nova-compute[71026]:   </features>
Jul 27 16:45:35 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:45:35 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:45:35 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:45:35 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:45:35 user nova-compute[71026]:   </clock>
Jul 27 16:45:35 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:45:35 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:45:35 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:45:35 user nova-compute[71026]:   </cpu>
Jul 27 16:45:35 user nova-compute[71026]:   <devices>
Jul 27 16:45:35 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:45:35 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:45:35 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk"/>
Jul 27 16:45:35 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:45:35 user nova-compute[71026]:     </disk>
Jul 27 16:45:35 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:45:35 user nova-compute[71026]:       <mac address="fa:16:3e:b1:dd:19"/>
Jul 27 16:45:35 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:45:35 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:45:35 user nova-compute[71026]:       <target dev="tapddac2e8f-8e"/>
Jul 27 16:45:35 user nova-compute[71026]:     </interface>
Jul 27 16:45:35 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:45:35 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/console.log" append="off"/>
Jul 27 16:45:35 user nova-compute[71026]:     </serial>
Jul 27 16:45:35 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:45:35 user nova-compute[71026]:     <video>
Jul 27 16:45:35 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:45:35 user nova-compute[71026]:     </video>
Jul 27 16:45:35 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:45:35 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:45:35 user nova-compute[71026]:     </rng>
Jul 27 16:45:35 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:45:35 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:45:35 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:45:35 user nova-compute[71026]:     </memballoon>
Jul 27 16:45:35 user nova-compute[71026]:   </devices>
Jul 27 16:45:35 user nova-compute[71026]: </domain>
Jul 27 16:45:35 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-296855908',display_name='tempest-TestServerVolumeAttachmentScenario-server-296855908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-296855908',id=24,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx6UCK7J2te/k4rOnuGO7R0HwISeat6Wb32EW1nnNtCSvRtHcn4LYHzgAGykaBzy8SWxX//6e++0ZHUhApYQw72LJG3S046QluKOKHozCG7ifeKq6up5MHIBSAaUdB5mQ==',key_name='tempest-keypair-1063992593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='351160478929495bb63cb9c9ac562a72',ramdisk_id='',reservation_id='r-eeul353d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-224674346',owner_user_name='tempest-TestServerVolumeAttachmentScenario-224674346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef212322604675b67d86e73ab0878a',uuid=9c16cbdd-c74b-471f-acf9-232d88682f2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converting VIF {"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG os_vif [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddac2e8f-8e, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddac2e8f-8e, col_values=(('external_ids', {'iface-id': 'ddac2e8f-8e32-42aa-99b3-d8f1cbec145a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:dd:19', 'vm-uuid': '9c16cbdd-c74b-471f-acf9-232d88682f2e'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:45:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:35 user nova-compute[71026]: INFO os_vif [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e')
Jul 27 16:45:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:45:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No VIF found with MAC fa:16:3e:b1:dd:19, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:45:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updated VIF entry in instance network info cache for port ddac2e8f-8e32-42aa-99b3-d8f1cbec145a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:45:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating instance_info_cache with network_info: [{"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:45:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba11f375-ce8e-419c-aa0a-cf21de76ca15 req-2169e59c-94c4-4b66-8418-211bb310ea98 service nova] Releasing lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] No waiting events found dispatching network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:37 user nova-compute[71026]: WARNING nova.compute.manager [req-972bfdd8-3472-4f5a-8b10-c610fd220f34 req-340efd6a-e465-41b9-bab2-76192fae9b3d service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received unexpected event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a for instance with vm_state building and task_state spawning.
Jul 27 16:45:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] No waiting events found dispatching network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:45:39 user nova-compute[71026]: WARNING nova.compute.manager [req-765b34cc-baf6-455c-9b1a-564ab587bb57 req-92cbd45f-a11f-42df-a488-a7f3872a379b service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received unexpected event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a for instance with vm_state building and task_state spawning.
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476339.8072727, 9c16cbdd-c74b-471f-acf9-232d88682f2e => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] VM Resumed (Lifecycle Event)
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Instance spawned successfully.
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476339.8119555, 9c16cbdd-c74b-471f-acf9-232d88682f2e => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] VM Started (Lifecycle Event)
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:45:39 user nova-compute[71026]: INFO nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Took 6.16 seconds to spawn the instance on the hypervisor.
Jul 27 16:45:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:45:40 user nova-compute[71026]: INFO nova.compute.manager [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Took 6.88 seconds to build instance.
Jul 27 16:45:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c358cbf3-b090-4636-9eff-20443ffb21df tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.989s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:45:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:45:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:00 user nova-compute[71026]: INFO nova.compute.manager [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Detaching volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1
Jul 27 16:46:00 user nova-compute[71026]: INFO nova.virt.block_device [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Attempting to driver detach volume d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 from mountpoint /dev/vdb
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Attempting to detach device vdb from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:46:00 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:46:00 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:46:00 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:46:00 user nova-compute[71026]:   <serial>d5fd19b0-0fd0-4b88-8402-99ca5096dbb1</serial>
Jul 27 16:46:00 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 16:46:00 user nova-compute[71026]: </disk>
Jul 27 16:46:00 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:46:00 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully detached device vdb from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the persistent domain config.
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:46:00 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:46:00 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:46:00 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:46:00 user nova-compute[71026]:   <serial>d5fd19b0-0fd0-4b88-8402-99ca5096dbb1</serial>
Jul 27 16:46:00 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 16:46:00 user nova-compute[71026]: </disk>
Jul 27 16:46:00 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476360.9504519, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:46:00 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully detached device vdb from instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 from the live domain config.
Jul 27 16:46:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYNqExRW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:00 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58918dd-9ca2-4fe6-b8c5-38a7c06cfefd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:46:00 user nova-compute[71026]: No targets found.
Jul 27 16:46:00 user nova-compute[71026]: iSNS:
Jul 27 16:46:00 user nova-compute[71026]: No targets found.
Jul 27 16:46:00 user nova-compute[71026]: STATIC:
Jul 27 16:46:00 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09
Jul 27 16:46:00 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:00 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:00 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:46:00 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:00 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:00 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1
Jul 27 16:46:00 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:00 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:00 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:46:00 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:00 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:00 user nova-compute[71026]: FIRMWARE:
Jul 27 16:46:00 user nova-compute[71026]: No targets found.
Jul 27 16:46:00 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:46:00 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:46:00 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86864d3-4876-4f01-984e-1f5549a340df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be10a52-a485-4392-8434-c5d4496804d3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:01 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a81ac040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4733df0-9e6e-4be5-9b15-cb2940477a25]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40789367-b9f2-4a1f-9c7b-d4c1fa279107]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0e050b-9837-4810-8237-ae893eddb6e7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571bfc6-fe1e-4e9d-bc66-cbe0d5ec5fa7]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2061db87-8d28-4cdd-8b0a-377f0490ede1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6d1a0-f9a5-4867-8bd8-ccf3384942f3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260]
Jul 27 16:46:01 user nova-compute[71026]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:01 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5fd19b0-0fd0-4b88-8402-99ca5096dbb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf55edd-762b-4858-944b-97284abb296b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== disconnect_volume: return (302ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:46:02 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'flavor' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a0767030-a203-4201-8bc6-7dc26fd4558f tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:46:03 user nova-compute[71026]: INFO nova.compute.claims [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Claim successful on node user
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 16:46:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:46:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:46:04 user nova-compute[71026]: INFO nova.virt.block_device [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Booting with volume snapshot c54e027c-cbcc-434d-9c4b-065765fc3313 at /dev/vda
Jul 27 16:46:04 user nova-compute[71026]: DEBUG nova.policy [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:46:05 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Successfully created port: 74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:46:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Successfully updated port: 74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-changed-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Refreshing instance network info cache due to event network-changed-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] Acquiring lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Updating instance_info_cache with network_info: [{"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Instance network_info: |[{"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] Acquired lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Refreshing network info cache for port 74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Updated VIF entry in instance network info cache for port 74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG nova.network.neutron [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Updating instance_info_cache with network_info: [{"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4750ed33-c044-43e3-a10e-e985826ca169 req-c0a390dd-e588-4017-9bf9-1c85a9d1fd50 service nova] Releasing lock "refresh_cache-d143550a-2e32-4a1d-9d42-c05de62f0561" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.utils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bfcdbf-88c6-4dc7-ab2f-ca41ddc82e99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e1d70-ef1c-4187-a401-41d5c867b4a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce1ef0-6fb9-4875-a955-de4437789775]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0daa3d1-596a-44c9-80d3-3ba0d03a95ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:10 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:46:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80459d-a274-4000-a0b0-81eed5a2f492]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG os_brick.utils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:10 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Updating existing volume attachment record: c92f04bd-e319-4698-ba86-5e5b9be95e81 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:46:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-changed-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Refreshing instance network info cache due to event network-changed-b1953529-8ca6-4160-9163-410e682544d9. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] Acquiring lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] Acquired lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Refreshing network info cache for port b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updated VIF entry in instance network info cache for port b1953529-8ca6-4160-9163-410e682544d9. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating instance_info_cache with network_info: [{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e8f3f9af-938a-48af-8b25-e0aa38e7a47c req-d48558f9-7e04-401e-839c-89ca557bb006 service nova] Releasing lock "refresh_cache-dae8f77e-2791-48e6-8803-d0660647ab18" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:13 user nova-compute[71026]: INFO nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Rebuilding instance
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'trusted_certs' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'pci_requests' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'pci_devices' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'resources' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'migration_context' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71026) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:13 user nova-compute[71026]: WARNING nova.compute.manager [req-0b78c5b7-9981-4c9a-9b0a-8bddf3b2f890 req-22829dde-e647-4721-bbd5-76b8c707df83 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state active and task_state rebuilding.
Jul 27 16:46:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance destroyed successfully.
Jul 27 16:46:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance destroyed successfully.
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-883496871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1953529-8c, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:14 user nova-compute[71026]: INFO os_vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c')
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:14 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65d2159-30b3-4950-ac62-84171dc93b0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]: iSNS:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]: STATIC:
Jul 27 16:46:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09
Jul 27 16:46:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:46:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:46:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:14 user nova-compute[71026]: FIRMWARE:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:46:14 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:46:14 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8fdc17-4998-472d-954b-3d5b1d9e7ff6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df22749-4e83-4ac8-961f-289c93703743]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30884752d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d239529c-b87d-4d07-af9b-edb06e64612b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3dde7-f955-48ee-b32d-f74303dd7ae5]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[345cdbad-f330-4698-961a-99cae6e0bc4e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cbe057-ad45-485e-90d5-95af40b56a64]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[33887573-dc96-410e-a780-b1f63f40ad19]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d14b7d-a84e-43cc-9e86-07d40de65321]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]
Jul 27 16:46:14 user nova-compute[71026]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[941ed5a2-baf6-4749-ab87-09968eae4b66]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== disconnect_volume: return (322ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:46:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deleting instance files /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18_del
Jul 27 16:46:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deletion of /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18_del complete
Jul 27 16:46:14 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance dae8f77e-2791-48e6-8803-d0660647ab18 could not be found.
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:14 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de63f2-02c5-46ee-914a-c031ce42be95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]: iSNS:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]: STATIC:
Jul 27 16:46:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:46:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:46:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:14 user nova-compute[71026]: FIRMWARE:
Jul 27 16:46:14 user nova-compute[71026]: No targets found.
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:46:14 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:46:14 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a1d5b4-8943-46a2-9b1a-96a70fc710ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dba78dd-9213-46b8-ac26-5250225560a4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088476c20>, {}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Disconnecting from: [] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== disconnect_volume: return (74ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:15 user nova-compute[71026]: WARNING nova.compute.manager [req-bf067f93-1e67-48d2-b839-6d5eefa25552 req-a91dbf5d-a2af-4f4d-baa7-fc2bb6ab4765 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state active and task_state rebuilding.
Jul 27 16:46:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Preparing to wait for external event volume-reimaged-3b5788d5-58d3-42cd-a6a0-16786e351a09 {{(pid=71026) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:46:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Creating image(s)
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Ensure instance console log exists: /opt/stack/data/nova/instances/d143550a-2e32-4a1d-9d42-c05de62f0561/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Start _get_guest_xml network_info=[{"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c92f04bd-e319-4698-ba86-5e5b9be95e81', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXjmsdOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd143550a-2e32-4a1d-9d42-c05de62f0561', 'attached_at': '', 'detached_at': '', 'volume_id': '25d39590-6337-43fe-a53d-6782814a12ab', 'serial': '25d39590-6337-43fe-a53d-6782814a12ab'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:46:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:46:17 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXjmsdOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:17 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:17 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:17 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1339a2-94e9-4a19-a6c8-3bf86981a3d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:46:17 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc3af4d-f8f6-4216-9490-8f026dbbd0c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab] added
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781da22-a8ce-4345-b989-a3c955a7bff0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1dd1e2-0616-4b20-9146-1e832e074c44]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXjmsdOA {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXjmsdOA" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b3dc3-5ae4-4b22-b8db-3887ca45dbba]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXjmsdOA'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fcfd2d-e643-4227-8166-43769f4b9ed0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df5f0b-48e5-423f-a1ae-cd2c4a3e96dc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41625a-6666-4e2b-adac-d5692e500090]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260]
Jul 27 16:46:17 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c2a781-4916-4798-a963-53e7e292954d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f9e67-851d-45b1-bcf4-d7bdf3fa04fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:17 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f3cb12-6598-49a1-9b3e-f65199209caf]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:46:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXjmsdOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-changed-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Refreshing instance network info cache due to event network-changed-d4d5e45c-b26e-492f-9a92-f0bc0c120325. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.network.neutron [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Refreshing network info cache for port d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23033643434613332', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033643434613332', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091198162',display_name='tempest-TestVolumeBootPattern-server-2091198162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091198162',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ydwo380p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:04Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=d143550a-2e32-4a1d-9d42-c05de62f0561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid d143550a-2e32-4a1d-9d42-c05de62f0561 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:46:18 user nova-compute[71026]:   <uuid>d143550a-2e32-4a1d-9d42-c05de62f0561</uuid>
Jul 27 16:46:18 user nova-compute[71026]:   <name>instance-00000019</name>
Jul 27 16:46:18 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:46:18 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:46:18 user nova-compute[71026]:   <metadata>
Jul 27 16:46:18 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:46:18 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:46:18 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-server-2091198162</nova:name>
Jul 27 16:46:18 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:46:17</nova:creationTime>
Jul 27 16:46:18 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:46:18 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:46:18 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:46:18 user nova-compute[71026]:       <nova:owner>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:46:18 user nova-compute[71026]:       </nova:owner>
Jul 27 16:46:18 user nova-compute[71026]:       <nova:ports>
Jul 27 16:46:18 user nova-compute[71026]:         <nova:port uuid="74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c">
Jul 27 16:46:18 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:46:18 user nova-compute[71026]:         </nova:port>
Jul 27 16:46:18 user nova-compute[71026]:       </nova:ports>
Jul 27 16:46:18 user nova-compute[71026]:     </nova:instance>
Jul 27 16:46:18 user nova-compute[71026]:   </metadata>
Jul 27 16:46:18 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:46:18 user nova-compute[71026]:     <system>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="serial">d143550a-2e32-4a1d-9d42-c05de62f0561</entry>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="uuid">d143550a-2e32-4a1d-9d42-c05de62f0561</entry>
Jul 27 16:46:18 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:46:18 user nova-compute[71026]:     </system>
Jul 27 16:46:18 user nova-compute[71026]:   </sysinfo>
Jul 27 16:46:18 user nova-compute[71026]:   <os>
Jul 27 16:46:18 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:46:18 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:46:18 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:46:18 user nova-compute[71026]:   </os>
Jul 27 16:46:18 user nova-compute[71026]:   <features>
Jul 27 16:46:18 user nova-compute[71026]:     <acpi/>
Jul 27 16:46:18 user nova-compute[71026]:     <apic/>
Jul 27 16:46:18 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:46:18 user nova-compute[71026]:   </features>
Jul 27 16:46:18 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:46:18 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:46:18 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:46:18 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:46:18 user nova-compute[71026]:   </clock>
Jul 27 16:46:18 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:46:18 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:46:18 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:46:18 user nova-compute[71026]:   </cpu>
Jul 27 16:46:18 user nova-compute[71026]:   <devices>
Jul 27 16:46:18 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:46:18 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:46:18 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:46:18 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:46:18 user nova-compute[71026]:       <serial>25d39590-6337-43fe-a53d-6782814a12ab</serial>
Jul 27 16:46:18 user nova-compute[71026]:     </disk>
Jul 27 16:46:18 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:46:18 user nova-compute[71026]:       <mac address="fa:16:3e:82:c1:17"/>
Jul 27 16:46:18 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:46:18 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:46:18 user nova-compute[71026]:       <target dev="tap74bb2384-f5"/>
Jul 27 16:46:18 user nova-compute[71026]:     </interface>
Jul 27 16:46:18 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:46:18 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/d143550a-2e32-4a1d-9d42-c05de62f0561/console.log" append="off"/>
Jul 27 16:46:18 user nova-compute[71026]:     </serial>
Jul 27 16:46:18 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:46:18 user nova-compute[71026]:     <video>
Jul 27 16:46:18 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:46:18 user nova-compute[71026]:     </video>
Jul 27 16:46:18 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:46:18 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:46:18 user nova-compute[71026]:     </rng>
Jul 27 16:46:18 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:46:18 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:46:18 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:46:18 user nova-compute[71026]:     </memballoon>
Jul 27 16:46:18 user nova-compute[71026]:   </devices>
Jul 27 16:46:18 user nova-compute[71026]: </domain>
Jul 27 16:46:18 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091198162',display_name='tempest-TestVolumeBootPattern-server-2091198162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091198162',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ydwo380p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:04Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=d143550a-2e32-4a1d-9d42-c05de62f0561,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG os_vif [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74bb2384-f5, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74bb2384-f5, col_values=(('external_ids', {'iface-id': '74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c1:17', 'vm-uuid': 'd143550a-2e32-4a1d-9d42-c05de62f0561'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:18 user nova-compute[71026]: INFO os_vif [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5')
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:46:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:82:c1:17, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:46:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:19 user nova-compute[71026]: DEBUG nova.network.neutron [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updated VIF entry in instance network info cache for port d4d5e45c-b26e-492f-9a92-f0bc0c120325. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:46:19 user nova-compute[71026]: DEBUG nova.network.neutron [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b87c0a6-060b-4fa5-bf21-a09676b0fad3 req-6cf31dd3-b885-409d-8801-ebb172d90bd3 service nova] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] No waiting events found dispatching network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:20 user nova-compute[71026]: WARNING nova.compute.manager [req-cd53208f-4ef9-4a00-ba4d-7f5bbd688dd8 req-4e439ace-1c66-424d-9843-32290247110b service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received unexpected event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c for instance with vm_state building and task_state spawning.
Jul 27 16:46:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476382.199238, d143550a-2e32-4a1d-9d42-c05de62f0561 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] VM Resumed (Lifecycle Event)
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Instance spawned successfully.
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476382.199805, d143550a-2e32-4a1d-9d42-c05de62f0561 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] VM Started (Lifecycle Event)
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] No waiting events found dispatching network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:22 user nova-compute[71026]: WARNING nova.compute.manager [req-1464520a-2bb2-4686-a2c4-e1491a517a6c req-961f596f-d72c-4dbe-8186-3cfc5a5c3cd6 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received unexpected event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c for instance with vm_state building and task_state spawning.
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:46:22 user nova-compute[71026]: INFO nova.compute.manager [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Took 18.78 seconds to build instance.
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2521361e-471c-45f6-94bb-3b540d8ad615 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.922s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:23 user nova-compute[71026]: INFO nova.compute.manager [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Attaching volume 350b6fba-6003-491a-acee-5c9399e8d086 to /dev/vdb
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.utils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f600649-2e45-42b1-bddc-9f344a5ea57f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:46:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.674957275390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b3214e-5275-475f-bb8e-ac0dd6079b81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be44dff5-3f95-412a-888f-434fcc4b862b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd672c-8e7d-4213-83a0-3eff2c03a531]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:23 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:46:23 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f10ba-5a84-47ab-803d-9439d7a0ad35]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG os_brick.utils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== get_connector_properties: return (577ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating existing volume attachment record: 058360d9-5758-48f9-b528-ff08021b3ff4 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dae8f77e-2791-48e6-8803-d0660647ab18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9c16cbdd-c74b-471f-acf9-232d88682f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d143550a-2e32-4a1d-9d42-c05de62f0561 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:46:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:46:24 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:46:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:24 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:46:24 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:46:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [{"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-b991c2a5-894c-49e7-896c-69eb95eb84bd" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:46:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:29 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476374.0203807, dae8f77e-2791-48e6-8803-d0660647ab18 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:29 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Stopped (Lifecycle Event)
Jul 27 16:46:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-86a70e8b-c36e-431b-9fdb-76211911c632 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:31 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:31 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:31 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e735019-dbc1-4623-b104-bdeceafa5f62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:46:31 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fde586-e947-46bc-bd8e-ba59f7f0a43b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086] added
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[76190c3d-2894-4783-a5b4-22c7d431328d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d67f934-c868-4768-918b-3ecb3edc5795]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhgOyGo {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhgOyGo" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e771e04-ac59-49fc-a30b-0eb1ef70b4e4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQhgOyGo'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8ea18-0050-4ac3-ba27-5b416ccca27f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e3e36b-3118-48a6-b80c-528e3104f28e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bedd56b-6295-495e-bbf8-8eaeec60d047]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]
Jul 27 16:46:31 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20971a-cc1f-440a-bf2c-60f3a06fd117]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[236da917-88a9-443a-bc08-bc83263d00ec]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:31 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a140a6-42bf-4f18-a2f3-7b5cf4cfeea4]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:46:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-6ac7567f-3321-4b4d-833a-e264aaafc03e req-970c75a7-9e85-44c0-858c-46ed700d1250 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event volume-reimaged-3b5788d5-58d3-42cd-a6a0-16786e351a09 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6ac7567f-3321-4b4d-833a-e264aaafc03e req-970c75a7-9e85-44c0-858c-46ed700d1250 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6ac7567f-3321-4b4d-833a-e264aaafc03e req-970c75a7-9e85-44c0-858c-46ed700d1250 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6ac7567f-3321-4b4d-833a-e264aaafc03e req-970c75a7-9e85-44c0-858c-46ed700d1250 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-6ac7567f-3321-4b4d-833a-e264aaafc03e req-970c75a7-9e85-44c0-858c-46ed700d1250 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Processing event volume-reimaged-3b5788d5-58d3-42cd-a6a0-16786e351a09 {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:46:32 user nova-compute[71026]: INFO nova.virt.block_device [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Booting with volume 3b5788d5-58d3-42cd-a6a0-16786e351a09 at /dev/vda
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.utils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1797cb6-c239-4d9b-a199-1b92085f2875]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed00ee70-d0be-49c6-abe9-8bce0490b9f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[479bfbd2-6055-4380-9fee-cef8a882da46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be756502-8066-49ee-9773-abc49f07860a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:46:32 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:46:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33b4cf8-eb7a-480b-99ed-c0f148bc3cf3]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.utils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating existing volume attachment record: cfb257c7-b1f1-47a7-8f78-4e2c128255cf {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23230343831303764', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230343831303764', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing instance network info cache due to event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:46:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:46:33 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:46:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:46:33 user nova-compute[71026]:   <serial>350b6fba-6003-491a-acee-5c9399e8d086</serial>
Jul 27 16:46:33 user nova-compute[71026]: </disk>
Jul 27 16:46:33 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No VIF found with MAC fa:16:3e:92:e9:89, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updated VIF entry in instance network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bececb32-74de-4e68-ab70-92a509956c59 req-aec6a476-788b-4c75-b00a-cbd5efe89fc1 service nova] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e38a6fe-ecbf-4b17-b861-c0ec3404da43 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.598s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71026) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 16:46:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance destroyed successfully.
Jul 27 16:46:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-31cedbb4-8172-449d-894f-1ff4db6786aa tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.914s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:34 user nova-compute[71026]: INFO nova.compute.manager [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Shelve offloading
Jul 27 16:46:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:35 user nova-compute[71026]: WARNING nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state None.
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:35 user nova-compute[71026]: WARNING nova.compute.manager [req-7e5ca069-5bbe-41b2-b83d-e99657127dab req-a87a4ca6-ec6e-4ef2-811d-9809bb1f7754 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state None.
Jul 27 16:46:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance destroyed successfully.
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:46:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:37 user nova-compute[71026]: WARNING nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state active and task_state shelving.
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:37 user nova-compute[71026]: WARNING nova.compute.manager [req-8fc7b943-21f8-4717-b5a2-3de62d7ea672 req-682599bb-51f0-4895-ae23-ae492da5436a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state active and task_state shelving.
Jul 27 16:46:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance destroyed successfully.
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'resources' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTdxKL7iEwgys02p15YUAFpKg4miLcztjkjASObzm9oJItTISnaWlEnZp4YSKUkoYfuloTYK5R+0f8ddEbTV7HusTnRKkgwdeEJMxrnts6YZFBuLVnOK/xby7KGXDk6Sg==',key_name='tempest-TestShelveInstance-1110890233',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:44:55Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_vif [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42e5797d-04, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing instance network info cache due to event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.network.neutron [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:37 user nova-compute[71026]: INFO os_vif [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04')
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:37 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e20b53-97c2-4ee8-80b8-43196ea6384b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:46:37 user nova-compute[71026]: No targets found.
Jul 27 16:46:37 user nova-compute[71026]: iSNS:
Jul 27 16:46:37 user nova-compute[71026]: No targets found.
Jul 27 16:46:37 user nova-compute[71026]: STATIC:
Jul 27 16:46:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:46:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:46:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:46:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:37 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab
Jul 27 16:46:37 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:46:37 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:46:37 user nova-compute[71026]: FIRMWARE:
Jul 27 16:46:37 user nova-compute[71026]: No targets found.
Jul 27 16:46:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:46:37 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:46:37 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d8e464-3d7e-411c-aa3e-ce008dda5bd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f1cd5-0a6b-4da4-8823-fc605d6db43b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:37 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80b2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab98553-ba3b-4bad-87ba-6eb12cd4538f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8939c2c-522a-48be-ab8f-5aba69d394ea]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a54c1f8-76bb-42e7-a372-0cd5fa8f665c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[278619e6-4c9f-40d6-abed-09b1e6888911]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45983446-6e6f-403d-9420-6195646d9e88]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a446e0a-ac4e-4a1d-86c4-725e9bd9a2d4]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]
Jul 27 16:46:37 user nova-compute[71026]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:37 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[102b91bf-fcc2-45c9-90dd-ac0e13288f10]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== disconnect_volume: return (343ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:46:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deleting instance files /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1_del
Jul 27 16:46:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deletion of /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1_del complete
Jul 27 16:46:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updated VIF entry in instance network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:46:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": null, "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap42e5797d-04", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80f84558-5829-4b12-b9ed-4ce0e61d8fdc req-2720aa05-bf50-47fa-afc5-22169a25f357 service nova] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:38 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Deleted allocations for instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1
Jul 27 16:46:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'numa_topology' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d0db310a-f700-47c2-aa2e-a04e3270302a tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.496s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:46:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Creating image(s)
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Ensure instance console log exists: /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start _get_guest_xml network_info=[{"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cfb257c7-b1f1-47a7-8f78-4e2c128255cf', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dae8f77e-2791-48e6-8803-d0660647ab18', 'attached_at': '', 'detached_at': '', 'volume_id': '3b5788d5-58d3-42cd-a6a0-16786e351a09', 'serial': '3b5788d5-58d3-42cd-a6a0-16786e351a09'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:46:41 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 16:46:41 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'vcpu_model' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:46:41 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:41 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:46:41 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a641c-5171-46f5-90be-e791a3126ced]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:46:41 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[730f4d11-33a9-4e95-bb7c-2def2bbe610f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09] added
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8253f40-3b40-41ce-ad64-37104796b052]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[858abc62-ad8d-4676-a248-0b8af138f748]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSkdcDHr {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wSkdcDHr" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcee39a-56b1-4d89-be70-beb94d7b31b1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wSkdcDHr'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f1fc12-6fe2-4fc4-b4e9-820e5c14e832]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a5f123-2014-4739-a189-be18b55cdc46]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c329820-41a0-4cb1-a3f0-64bbc85d6767]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]
Jul 27 16:46:41 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[893def02-73f3-49b4-861e-d59c6543ef7d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755d1ed-061c-4b02-b966-309aa9376534]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:46:41 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847f4ab-06d6-4ccd-9c63-b5274776310e]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:46:41 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26264626164376464', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264626164376464', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-883496871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:46:42 user nova-compute[71026]:   <uuid>dae8f77e-2791-48e6-8803-d0660647ab18</uuid>
Jul 27 16:46:42 user nova-compute[71026]:   <name>instance-00000015</name>
Jul 27 16:46:42 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:46:42 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:46:42 user nova-compute[71026]:   <metadata>
Jul 27 16:46:42 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:46:42 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:46:42 user nova-compute[71026]:       <nova:name>tempest-ServerActionsV293TestJSON-server-883496871</nova:name>
Jul 27 16:46:42 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:46:41</nova:creationTime>
Jul 27 16:46:42 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:46:42 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:46:42 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:46:42 user nova-compute[71026]:       <nova:owner>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:user uuid="072754b24f114dea8b70d8ce6370d7e3">tempest-ServerActionsV293TestJSON-510559864-project-member</nova:user>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:project uuid="0dac247d812f44c28c003f764b784304">tempest-ServerActionsV293TestJSON-510559864</nova:project>
Jul 27 16:46:42 user nova-compute[71026]:       </nova:owner>
Jul 27 16:46:42 user nova-compute[71026]:       <nova:ports>
Jul 27 16:46:42 user nova-compute[71026]:         <nova:port uuid="b1953529-8ca6-4160-9163-410e682544d9">
Jul 27 16:46:42 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:46:42 user nova-compute[71026]:         </nova:port>
Jul 27 16:46:42 user nova-compute[71026]:       </nova:ports>
Jul 27 16:46:42 user nova-compute[71026]:     </nova:instance>
Jul 27 16:46:42 user nova-compute[71026]:   </metadata>
Jul 27 16:46:42 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:46:42 user nova-compute[71026]:     <system>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="serial">dae8f77e-2791-48e6-8803-d0660647ab18</entry>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="uuid">dae8f77e-2791-48e6-8803-d0660647ab18</entry>
Jul 27 16:46:42 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:46:42 user nova-compute[71026]:     </system>
Jul 27 16:46:42 user nova-compute[71026]:   </sysinfo>
Jul 27 16:46:42 user nova-compute[71026]:   <os>
Jul 27 16:46:42 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:46:42 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:46:42 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:46:42 user nova-compute[71026]:   </os>
Jul 27 16:46:42 user nova-compute[71026]:   <features>
Jul 27 16:46:42 user nova-compute[71026]:     <acpi/>
Jul 27 16:46:42 user nova-compute[71026]:     <apic/>
Jul 27 16:46:42 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:46:42 user nova-compute[71026]:   </features>
Jul 27 16:46:42 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:46:42 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:46:42 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:46:42 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:46:42 user nova-compute[71026]:   </clock>
Jul 27 16:46:42 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:46:42 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:46:42 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:46:42 user nova-compute[71026]:   </cpu>
Jul 27 16:46:42 user nova-compute[71026]:   <devices>
Jul 27 16:46:42 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:46:42 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:46:42 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:46:42 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:46:42 user nova-compute[71026]:       <serial>3b5788d5-58d3-42cd-a6a0-16786e351a09</serial>
Jul 27 16:46:42 user nova-compute[71026]:     </disk>
Jul 27 16:46:42 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:46:42 user nova-compute[71026]:       <mac address="fa:16:3e:73:27:be"/>
Jul 27 16:46:42 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:46:42 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:46:42 user nova-compute[71026]:       <target dev="tapb1953529-8c"/>
Jul 27 16:46:42 user nova-compute[71026]:     </interface>
Jul 27 16:46:42 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:46:42 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18/console.log" append="off"/>
Jul 27 16:46:42 user nova-compute[71026]:     </serial>
Jul 27 16:46:42 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:46:42 user nova-compute[71026]:     <video>
Jul 27 16:46:42 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:46:42 user nova-compute[71026]:     </video>
Jul 27 16:46:42 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:46:42 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:46:42 user nova-compute[71026]:     </rng>
Jul 27 16:46:42 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:46:42 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:46:42 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:46:42 user nova-compute[71026]:     </memballoon>
Jul 27 16:46:42 user nova-compute[71026]:   </devices>
Jul 27 16:46:42 user nova-compute[71026]: </domain>
Jul 27 16:46:42 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-883496871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG os_vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1953529-8c, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1953529-8c, col_values=(('external_ids', {'iface-id': 'b1953529-8ca6-4160-9163-410e682544d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:27:be', 'vm-uuid': 'dae8f77e-2791-48e6-8803-d0660647ab18'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:42 user nova-compute[71026]: INFO os_vif [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c')
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:46:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] No VIF found with MAC fa:16:3e:73:27:be, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:46:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:44 user nova-compute[71026]: WARNING nova.compute.manager [req-5def3911-b4d6-4c31-a397-81244c496182 req-cdd40c04-c119-4319-a6bd-b6cff565929f service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 16:46:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:45 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476405.9826734, dae8f77e-2791-48e6-8803-d0660647ab18 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:45 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Resumed (Lifecycle Event)
Jul 27 16:46:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:46:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:46:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance spawned successfully.
Jul 27 16:46:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:46:46 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476405.9828205, dae8f77e-2791-48e6-8803-d0660647ab18 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:46 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Started (Lifecycle Event)
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:46 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:46 user nova-compute[71026]: WARNING nova.compute.manager [req-ce44c1a8-0120-47a8-adf2-652b0aef5f80 req-960852f8-b3b1-445c-a8a2-3667e92c0af1 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state active and task_state rebuild_spawning.
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71026) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 27 16:46:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6ac7567f-3321-4b4d-833a-e264aaafc03e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:49 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476394.798819, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:49 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Stopped (Lifecycle Event)
Jul 27 16:46:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ed7c53d1-c9ec-4bd1-a5aa-6f4195e984b1 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ed7c53d1-c9ec-4bd1-a5aa-6f4195e984b1 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:50 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476395.717311, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:50 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Stopped (Lifecycle Event)
Jul 27 16:46:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-34f7b1f0-66ad-4b83-90b2-e689f7a5b8e4 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:53 user nova-compute[71026]: INFO nova.compute.manager [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Unrescuing
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'flavor' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:53 user nova-compute[71026]: WARNING nova.compute.manager [req-1fc13ac8-6fe0-44aa-b481-d5f4d1cdebdb req-8777b087-bb8e-4ca1-a5eb-eb0625ec9674 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance destroyed successfully.
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:55 user nova-compute[71026]: WARNING nova.compute.manager [req-b971cb46-2a81-406a-9db4-bb7f607c2e7b req-273f013a-d623-4acd-b389-e8b5c999395a service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:46:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 3550a85d-ed4d-4728-8398-23a171e6f40d due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476417.6058545, 3550a85d-ed4d-4728-8398-23a171e6f40d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Resumed (Lifecycle Event)
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e0d53fbd-3a2b-438f-8aa2-9b0f14e86f2c tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476417.6070702, 3550a85d-ed4d-4728-8398-23a171e6f40d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:46:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Started (Lifecycle Event)
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:46:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:46:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:46:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:46:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:46:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:46:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:46:58 user nova-compute[71026]: WARNING nova.compute.manager [req-5a17c38d-f498-4ded-9400-a153d8134921 req-6b7c1450-e8c5-4927-9d4b-37eb24200a46 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state active and task_state None.
Jul 27 16:46:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:18 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:47:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-changed-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Refreshing instance network info cache due to event network-changed-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] Acquiring lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] Acquired lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Refreshing network info cache for port ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updated VIF entry in instance network info cache for port ddac2e8f-8e32-42aa-99b3-d8f1cbec145a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating instance_info_cache with network_info: [{"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f58b49a7-4530-431d-b3e2-6c8ae4265271 req-8441b5e8-f05f-427a-a8a3-91234c098f84 service nova] Releasing lock "refresh_cache-9c16cbdd-c74b-471f-acf9-232d88682f2e" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:47:25 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:47:25 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7634MB free_disk=25.671260833740234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dae8f77e-2791-48e6-8803-d0660647ab18 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9c16cbdd-c74b-471f-acf9-232d88682f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d143550a-2e32-4a1d-9d42-c05de62f0561 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:25 user nova-compute[71026]: INFO nova.compute.manager [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attaching volume f9ba50b9-ef83-4efa-8ff7-084ffda6b272 to /dev/vdb
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.utils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98dfc3-7c54-4b8b-beaf-accd814f624a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e40a5f5-b739-407f-b6a8-39953c76da90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1ccbd-db33-4a31-8e63-0cb5bc50ef3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d7689-2b88-47c6-b07b-9a5ac1807577]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:25 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63288cf-56cd-41dd-8c7c-da64fe4e613c]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG os_brick.utils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating existing volume attachment record: a1c780d1-2a11-4b5b-ba43-7a5c8174cb5a {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:47:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:47:27 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:47:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [{"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:47:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:47:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:47:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpEvFDIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:32 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:32 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:32 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc81b9-63c3-40c5-b3be-ac55beee49da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:47:32 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e9bd2f-8781-4bed-a1e8-91069a731d87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272] added
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d4d75-1580-49c5-9eeb-4deb6603fbac]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db883f-2f2e-48eb-a9ce-18ac39977a59]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpEvFDIX {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lpEvFDIX" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e1eec-4074-49c9-8973-afc546720712]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lpEvFDIX'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d781e-eaea-45d8-a49b-149c1d24044a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a63890-df9a-4988-b45c-6e19ae02ff37]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[822237e0-c757-4f65-81e4-3c12d74262fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260]
Jul 27 16:47:32 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260] successful.
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c170a-6b46-4a5e-b404-a03750cfd519]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[914923b7-c507-4761-84c2-106fbebd48bc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:32 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf306c-f107-4b5d-b80e-69b86e8e3630]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:32 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpEvFDIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26364636138376231', 'path': '/dev/sdf'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364636138376231', 'path': '/dev/sdf'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:47:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:47:33 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 16:47:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:47:33 user nova-compute[71026]:   <serial>f9ba50b9-ef83-4efa-8ff7-084ffda6b272</serial>
Jul 27 16:47:33 user nova-compute[71026]: </disk>
Jul 27 16:47:33 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:47:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:47:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:47:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No VIF found with MAC fa:16:3e:b1:dd:19, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:47:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6acf7516-7f11-4b03-8461-a2ac0130f9fb tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.058s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:37 user nova-compute[71026]: INFO nova.compute.manager [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attaching volume d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea to /dev/vdc
Jul 27 16:47:37 user nova-compute[71026]: DEBUG os_brick.utils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d307b5f7-41d3-424e-bbf0-be4449cacb62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2544f9cf-9dff-484e-8f4b-3c679ff7ef15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fbebb2-3bf3-4efc-ba75-5e41b3a5c4d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[746581f6-1a24-4150-b475-afb5644ab82b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:38 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:47:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad64c7-9aea-4bab-b6be-28b2828b4a71]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:38 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating existing volume attachment record: 8fc49ef9-d92e-43e7-87b1-fe150acf0f55 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:47:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVDQpWMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:45 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25590b2-0203-459e-9627-c52254bb2aca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:47:45 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad30e359-e40b-4004-9ab8-412a69bdac5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea] added
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ecad46-fa52-4cab-8141-22b9627faf25]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb556d-5185-4784-8004-5396a72a96cc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVDQpWMN {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dVDQpWMN" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb907d-6bef-4046-8a2c-e63fec7c6001]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dVDQpWMN'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420e5cd-2dad-4d33-8a4d-2481769a0c17]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f082c350-1e8b-49a4-b0e6-92581648f92a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54efb557-6e9d-44e9-ae10-c4af7cbe9a70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260]
Jul 27 16:47:45 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260] successful.
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b528ae9-e563-4d3e-911c-eedf043739d9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab273b-6cac-48c9-a7f9-449966cc174d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:45 user nova-compute[71026]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)
Jul 27 16:47:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dc3d00-a409-4cf3-8b6c-3442e8e0c1c9]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVDQpWMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26437356530346330', 'path': '/dev/sdg'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437356530346330', 'path': '/dev/sdg'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:47:46 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:47:46 user nova-compute[71026]:   <source dev="/dev/sdg"/>
Jul 27 16:47:46 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:47:46 user nova-compute[71026]:   <serial>d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea</serial>
Jul 27 16:47:46 user nova-compute[71026]: </disk>
Jul 27 16:47:46 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:47:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] No VIF found with MAC fa:16:3e:b1:dd:19, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a54d43b6-2d72-4853-bc66-5a5a959ce0a4 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.491s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:47 user nova-compute[71026]: INFO nova.compute.manager [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Detaching volume d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea
Jul 27 16:47:47 user nova-compute[71026]: INFO nova.virt.block_device [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attempting to driver detach volume d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea from mountpoint /dev/vdc
Jul 27 16:47:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Attempting to detach device vdc from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:47:47 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:47:47 user nova-compute[71026]:   <source dev="/dev/sdg"/>
Jul 27 16:47:47 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:47:47 user nova-compute[71026]:   <serial>d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea</serial>
Jul 27 16:47:47 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:47:47 user nova-compute[71026]: </disk>
Jul 27 16:47:47 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:47:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully detached device vdc from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the persistent domain config.
Jul 27 16:47:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:47:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:47:47 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:47:47 user nova-compute[71026]:   <source dev="/dev/sdg"/>
Jul 27 16:47:47 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:47:47 user nova-compute[71026]:   <serial>d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea</serial>
Jul 27 16:47:47 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:47:47 user nova-compute[71026]: </disk>
Jul 27 16:47:47 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476468.372541, 9c16cbdd-c74b-471f-acf9-232d88682f2e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:47:48 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully detached device vdc from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the live domain config.
Jul 27 16:47:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dVDQpWMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[33627912-2051-4d60-951b-6fbd345b4ccf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:47:48 user nova-compute[71026]: No targets found.
Jul 27 16:47:48 user nova-compute[71026]: iSNS:
Jul 27 16:47:48 user nova-compute[71026]: No targets found.
Jul 27 16:47:48 user nova-compute[71026]: STATIC:
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab
Jul 27 16:47:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:48 user nova-compute[71026]: FIRMWARE:
Jul 27 16:47:48 user nova-compute[71026]: No targets found.
Jul 27 16:47:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:47:48 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:47:48 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c43db-23ae-459f-9be8-3d73f340bc9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0fc60-94f9-457a-a153-401f3388f21e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)
Jul 27 16:47:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:48 user nova-compute[71026]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea (non-flash)
Jul 27 16:47:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80d4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea'): ({'sdg'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Removing single pathed devices sdg {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74583941-18cb-49e2-95b7-f11fc81cdf9d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa6e64b-503a-4161-8e7e-84e09bd348fa]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Flushing IO for device /dev/sdg {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb84e84-41b6-4da4-a6da-c8a8b53521f6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b0d4f-444b-46a2-8b7c-60d7d5de58bb]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] SCSI volumes sdg have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45341df6-ed9c-4324-af81-24792bf46dde]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52442f-e149-4cb7-88b3-fd8c85c54e95]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260]
Jul 27 16:47:48 user nova-compute[71026]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea, portal: 172.16.0.220,3260] successful.
Jul 27 16:47:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2f4c2a7-d9d6-4fd0-9945-4c3238f756ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55006c72-7450-4be4-b182-51710f6e5885]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== disconnect_volume: return (320ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:47:49 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a97b2f0a-b825-42d1-897f-59098b300279 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.610s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:47:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:54 user nova-compute[71026]: INFO nova.compute.manager [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Terminating instance
Jul 27 16:47:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-unplugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] No waiting events found dispatching network-vif-unplugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-34e6fb0a-0785-4a9d-93ee-a67e8321d112 req-099d8581-6dc6-4911-8794-90bbd5c6bff3 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-unplugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:47:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Instance destroyed successfully.
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid d143550a-2e32-4a1d-9d42-c05de62f0561 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2091198162',display_name='tempest-TestVolumeBootPattern-server-2091198162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2091198162',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:46:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ydwo380p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:46:22Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=d143550a-2e32-4a1d-9d42-c05de62f0561,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "address": "fa:16:3e:82:c1:17", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74bb2384-f5", "ovs_interfaceid": "74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_vif [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74bb2384-f5, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:55 user nova-compute[71026]: INFO os_vif [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c1:17,bridge_name='br-int',has_traffic_filtering=True,id=74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74bb2384-f5')
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXjmsdOA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:55 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[268c3f38-6e00-4eb8-a4f8-43345d848fb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:47:55 user nova-compute[71026]: No targets found.
Jul 27 16:47:55 user nova-compute[71026]: iSNS:
Jul 27 16:47:55 user nova-compute[71026]: No targets found.
Jul 27 16:47:55 user nova-compute[71026]: STATIC:
Jul 27 16:47:55 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09
Jul 27 16:47:55 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:55 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:55 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:47:55 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:55 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:55 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:47:55 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:55 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:55 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:47:55 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:55 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:55 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab
Jul 27 16:47:55 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:47:55 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:47:55 user nova-compute[71026]: FIRMWARE:
Jul 27 16:47:55 user nova-compute[71026]: No targets found.
Jul 27 16:47:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:47:55 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:47:55 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab2e589-89f3-4597-82a5-af301d8a23ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2284b98-f762-4019-8e4d-1be272035dea]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:47:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30887a09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff922511-a720-46e4-b0c0-b296ca4ace01]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5ff73-3f10-409b-88b6-d607359cfa9a]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d7808-09e8-412a-b4b9-aa411570ddd9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652e16f-ee2a-4e44-a59c-0a05900a0a2f]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe630e072-03d44a3296ae45c1', '/dev/disk/by-id/scsi-23033643434613332', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e630e072') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:47:55 user nova-compute[71026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe630e072-03d44a3296ae45c1
Jul 27 16:47:55 user nova-compute[71026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23033643434613332
Jul 27 16:47:55 user nova-compute[71026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e630e072
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[581312ed-8c20-474b-90eb-5a305099e76d]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedd82db-f54e-48b2-8e6b-8ff7c7626e81]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e671b0-caf5-49b1-8504-2014c3ce7935]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260]
Jul 27 16:47:55 user nova-compute[71026]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab, portal: 172.16.0.220,3260] successful.
Jul 27 16:47:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25d39590-6337-43fe-a53d-6782814a12ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046cd35-010a-4b59-aa91-f77db5ca6d93]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (339ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:47:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Deleting instance files /opt/stack/data/nova/instances/d143550a-2e32-4a1d-9d42-c05de62f0561_del
Jul 27 16:47:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Deletion of /opt/stack/data/nova/instances/d143550a-2e32-4a1d-9d42-c05de62f0561_del complete
Jul 27 16:47:55 user nova-compute[71026]: INFO nova.compute.manager [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 27 16:47:55 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:47:55 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Took 0.46 seconds to deallocate network for instance.
Jul 27 16:47:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab4c64d1-b77d-4f42-9908-f46113be873f req-e270e29c-868c-4adf-be09-1978228c8358 service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-deleted-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] Acquiring lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] No waiting events found dispatching network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:47:56 user nova-compute[71026]: WARNING nova.compute.manager [req-1905f15f-57a2-496b-8138-3bfd5e2d4ccf req-081404e0-ad73-439e-aad0-ea5ae5b53d6f service nova] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Received unexpected event network-vif-plugged-74bb2384-f5c6-4a34-aaca-e0c6abe8ac9c for instance with vm_state active and task_state deleting.
Jul 27 16:47:56 user nova-compute[71026]: INFO nova.compute.manager [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Took 0.81 seconds to detach 1 volumes for instance.
Jul 27 16:47:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Deleting volume: 25d39590-6337-43fe-a53d-6782814a12ab {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:57 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:47:57 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:47:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:57 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance d143550a-2e32-4a1d-9d42-c05de62f0561
Jul 27 16:47:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f1853a6e-b188-47c1-ae3e-fb09df31cc68 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "d143550a-2e32-4a1d-9d42-c05de62f0561" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.025s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:47:58 user nova-compute[71026]: INFO nova.compute.claims [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Claim successful on node user
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:47:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:47:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:47:59 user nova-compute[71026]: INFO nova.virt.block_device [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Booting with volume d44e8cd6-67bc-4314-80de-998240af7770 at /dev/vda
Jul 27 16:47:59 user nova-compute[71026]: DEBUG nova.policy [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e106be16f498443091e8ae9f95311beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40b15450553d464cbeac2d3d910e8043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.utils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da85c88-586f-4e0a-a690-235b8df345fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f69595-f531-404f-bf49-dfa2ff67fe40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7df8a-f7bf-4f6d-ae23-af92356dc814]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6955a336-d690-4daf-9317-451d2d88f93b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:47:59 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:47:59 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b98f4f-412a-4cff-ac32-da3f7ac7c14e]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG os_brick.utils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating existing volume attachment record: a673f339-4efc-4181-8f26-af1e01af76c3 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:47:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Successfully created port: 16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Successfully updated port: 16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-changed-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Refreshing instance network info cache due to event network-changed-16e29a1c-b62b-48b5-88d5-0666f4d72b5f. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance network_info: |[{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Refreshing network info cache for port 16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:48:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updated VIF entry in instance network info cache for port 16e29a1c-b62b-48b5-88d5-0666f4d72b5f. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:48:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-276616f2-f830-4b80-8c04-99057d082e6f req-dcdbcdb4-ce3b-4874-9574-50bc90a28fa7 service nova] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:04 user nova-compute[71026]: INFO nova.compute.manager [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Terminating instance
Jul 27 16:48:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-f65187fd-00f7-46d2-8fbd-01d2075ddceb req-33292f6c-1505-4ea0-a24a-31510aa9c42e service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-unplugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Instance destroyed successfully.
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'resources' on Instance uuid dae8f77e-2791-48e6-8803-d0660647ab18 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-883496871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1044947004',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbxXerRTMpU8kxwji6iQ0p6mIhOi0R20LvmuK41gcWrKcgbIX3NFbWCR9CdEXhUogvmpF9/2LFEXw2L19ikVpOM9fcufbamAIRqnfELhiz31p5PIMoIH4A9R/LIuue19g==',key_name='tempest-keypair-573341144',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:46:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-swn9yfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=dae8f77e-2791-48e6-8803-d0660647ab18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "b1953529-8ca6-4160-9163-410e682544d9", "address": "fa:16:3e:73:27:be", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1953529-8c", "ovs_interfaceid": "b1953529-8ca6-4160-9163-410e682544d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_vif [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1953529-8c, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:05 user nova-compute[71026]: INFO os_vif [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:27:be,bridge_name='br-int',has_traffic_filtering=True,id=b1953529-8ca6-4160-9163-410e682544d9,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1953529-8c')
Jul 27 16:48:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wSkdcDHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:05 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f91533-5091-40f3-8799-986664111d4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:48:05 user nova-compute[71026]: No targets found.
Jul 27 16:48:05 user nova-compute[71026]: iSNS:
Jul 27 16:48:05 user nova-compute[71026]: No targets found.
Jul 27 16:48:05 user nova-compute[71026]: STATIC:
Jul 27 16:48:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09
Jul 27 16:48:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:48:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:48:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:48:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:05 user nova-compute[71026]: FIRMWARE:
Jul 27 16:48:05 user nova-compute[71026]: No targets found.
Jul 27 16:48:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:48:05 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:48:05 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac3e6b-40d6-40f7-9082-0df208152224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ed997-2a73-4e8b-ab2f-c26981cd7d82]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088540b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133b885-5486-4e87-a9fd-ff21f76e6f6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae692738-48d9-4113-a8f2-61818adad520]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ea3a3-ccca-4e3d-991e-402bc686b07c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48519469-05a4-4ab3-9093-6130ef7dea11]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26264626164376464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e77a2096', '/dev/disk/by-id/scsi-1SCST_BIOe77a2096-bdbad7dd61a9172a') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d07d0a-b102-414f-897d-0472273d6e8b]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e24df-52da-4ac9-b1b3-1dd1629532da]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfba843-2f17-4f91-8b74-bf3d8932816e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260]
Jul 27 16:48:05 user nova-compute[71026]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b5788d5-58d3-42cd-a6a0-16786e351a09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c7e96-0297-4727-9a7a-64ed6a0b88bb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] <== disconnect_volume: return (317ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:48:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deleting instance files /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18_del
Jul 27 16:48:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deletion of /opt/stack/data/nova/instances/dae8f77e-2791-48e6-8803-d0660647ab18_del complete
Jul 27 16:48:06 user nova-compute[71026]: INFO nova.compute.manager [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Took 1.24 seconds to destroy the instance on the hypervisor.
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:48:06 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Creating image(s)
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start _get_guest_xml network_info=[{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a673f339-4efc-4181-8f26-af1e01af76c3', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0aa475ea-5c70-4ff6-9141-9b088dc52ebf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd44e8cd6-67bc-4314-80de-998240af7770', 'serial': 'd44e8cd6-67bc-4314-80de-998240af7770'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:48:06 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:06 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:06 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:06 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dada60-4148-4b73-9a73-2077981a667f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:48:06 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f29da-10dc-464a-9d28-bdd644e1ea49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770] added
Jul 27 16:48:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9142676d-ead5-48d2-bda8-9684960713d2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86311ed-7d12-4fc6-b524-f7875772eb9f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXmwyHOU {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXmwyHOU" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[129b9a3c-5c53-49d1-aa73-3c8572cd9926]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KXmwyHOU'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b2cee-9128-40cc-8764-985f78110e64]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:06 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Took 0.83 seconds to deallocate network for instance.
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f611df5-174e-430c-b14c-92b5f7d9e6b5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:06 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[874dd15c-b721-4f6d-a1fb-8460c0e41642]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]
Jul 27 16:48:07 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cde9355-f4e9-4c7b-9700-28e2f2134a3b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f857ac1-043c-48c9-8317-6242a1e211b1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcf19e-4ff3-4db2-9841-c5d06480bf99]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] Acquiring lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] Lock "dae8f77e-2791-48e6-8803-d0660647ab18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] No waiting events found dispatching network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:07 user nova-compute[71026]: WARNING nova.compute.manager [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received unexpected event network-vif-plugged-b1953529-8ca6-4160-9163-410e682544d9 for instance with vm_state active and task_state deleting.
Jul 27 16:48:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-d76b68b1-c973-44a0-8318-5cf4aaa15d48 req-a8aa1ba1-a936-4867-bb16-dab989894f62 service nova] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Received event network-vif-deleted-b1953529-8ca6-4160-9163-410e682544d9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:07 user nova-compute[71026]: INFO nova.compute.manager [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 16:48:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Deleting volume: 3b5788d5-58d3-42cd-a6a0-16786e351a09 {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26234373138363237', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234373138363237', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.objects.instance [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:08 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Deleted allocations for instance dae8f77e-2791-48e6-8803-d0660647ab18
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:48:08 user nova-compute[71026]:   <uuid>0aa475ea-5c70-4ff6-9141-9b088dc52ebf</uuid>
Jul 27 16:48:08 user nova-compute[71026]:   <name>instance-0000001a</name>
Jul 27 16:48:08 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:48:08 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:48:08 user nova-compute[71026]:   <metadata>
Jul 27 16:48:08 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:48:08 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:48:08 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherA-server-1255413258</nova:name>
Jul 27 16:48:08 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:48:06</nova:creationTime>
Jul 27 16:48:08 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:48:08 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:48:08 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:48:08 user nova-compute[71026]:       <nova:owner>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:user uuid="e106be16f498443091e8ae9f95311beb">tempest-ServerActionsTestOtherA-1832986311-project-member</nova:user>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:project uuid="40b15450553d464cbeac2d3d910e8043">tempest-ServerActionsTestOtherA-1832986311</nova:project>
Jul 27 16:48:08 user nova-compute[71026]:       </nova:owner>
Jul 27 16:48:08 user nova-compute[71026]:       <nova:ports>
Jul 27 16:48:08 user nova-compute[71026]:         <nova:port uuid="16e29a1c-b62b-48b5-88d5-0666f4d72b5f">
Jul 27 16:48:08 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:48:08 user nova-compute[71026]:         </nova:port>
Jul 27 16:48:08 user nova-compute[71026]:       </nova:ports>
Jul 27 16:48:08 user nova-compute[71026]:     </nova:instance>
Jul 27 16:48:08 user nova-compute[71026]:   </metadata>
Jul 27 16:48:08 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:48:08 user nova-compute[71026]:     <system>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="serial">0aa475ea-5c70-4ff6-9141-9b088dc52ebf</entry>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="uuid">0aa475ea-5c70-4ff6-9141-9b088dc52ebf</entry>
Jul 27 16:48:08 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:48:08 user nova-compute[71026]:     </system>
Jul 27 16:48:08 user nova-compute[71026]:   </sysinfo>
Jul 27 16:48:08 user nova-compute[71026]:   <os>
Jul 27 16:48:08 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:48:08 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:48:08 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:48:08 user nova-compute[71026]:   </os>
Jul 27 16:48:08 user nova-compute[71026]:   <features>
Jul 27 16:48:08 user nova-compute[71026]:     <acpi/>
Jul 27 16:48:08 user nova-compute[71026]:     <apic/>
Jul 27 16:48:08 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:48:08 user nova-compute[71026]:   </features>
Jul 27 16:48:08 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:48:08 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:48:08 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:48:08 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:48:08 user nova-compute[71026]:   </clock>
Jul 27 16:48:08 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:48:08 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:48:08 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:48:08 user nova-compute[71026]:   </cpu>
Jul 27 16:48:08 user nova-compute[71026]:   <devices>
Jul 27 16:48:08 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:48:08 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:08 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:48:08 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:48:08 user nova-compute[71026]:       <serial>d44e8cd6-67bc-4314-80de-998240af7770</serial>
Jul 27 16:48:08 user nova-compute[71026]:     </disk>
Jul 27 16:48:08 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:48:08 user nova-compute[71026]:       <mac address="fa:16:3e:4f:f4:03"/>
Jul 27 16:48:08 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:08 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:48:08 user nova-compute[71026]:       <target dev="tap16e29a1c-b6"/>
Jul 27 16:48:08 user nova-compute[71026]:     </interface>
Jul 27 16:48:08 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:48:08 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf/console.log" append="off"/>
Jul 27 16:48:08 user nova-compute[71026]:     </serial>
Jul 27 16:48:08 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:48:08 user nova-compute[71026]:     <video>
Jul 27 16:48:08 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:08 user nova-compute[71026]:     </video>
Jul 27 16:48:08 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:48:08 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:48:08 user nova-compute[71026]:     </rng>
Jul 27 16:48:08 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:48:08 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:48:08 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:48:08 user nova-compute[71026]:     </memballoon>
Jul 27 16:48:08 user nova-compute[71026]:   </devices>
Jul 27 16:48:08 user nova-compute[71026]: </domain>
Jul 27 16:48:08 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG os_vif [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16e29a1c-b6, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16e29a1c-b6, col_values=(('external_ids', {'iface-id': '16e29a1c-b62b-48b5-88d5-0666f4d72b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:f4:03', 'vm-uuid': '0aa475ea-5c70-4ff6-9141-9b088dc52ebf'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:08 user nova-compute[71026]: INFO os_vif [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6')
Jul 27 16:48:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7e56dd4f-fd73-4d47-80b3-891582a3502e tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "dae8f77e-2791-48e6-8803-d0660647ab18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.405s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:48:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No VIF found with MAC fa:16:3e:4f:f4:03, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:09 user nova-compute[71026]: WARNING nova.compute.manager [req-6803db2a-aae4-4619-89a0-a824794fcb26 req-dd364530-fded-4d11-a88e-2b8efffb5e77 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state building and task_state spawning.
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:10 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476475.0106475, d143550a-2e32-4a1d-9d42-c05de62f0561 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:10 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] VM Stopped (Lifecycle Event)
Jul 27 16:48:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a6d802bf-f4b7-4a59-9ae1-94813221eeae None None] [instance: d143550a-2e32-4a1d-9d42-c05de62f0561] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476491.6767426, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Resumed (Lifecycle Event)
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance spawned successfully.
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476491.6800313, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Started (Lifecycle Event)
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:11 user nova-compute[71026]: WARNING nova.compute.manager [req-8dda3d2a-a8b4-4194-9c31-24cb7c1f3132 req-60dba60e-95cd-458d-af40-5e410ef622a1 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state building and task_state spawning.
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Took 5.13 seconds to spawn the instance on the hypervisor.
Jul 27 16:48:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:11 user nova-compute[71026]: INFO nova.compute.manager [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Took 13.49 seconds to build instance.
Jul 27 16:48:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8df45088-0ff9-4f1b-908a-15764b98629c tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.584s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:19 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:20 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476485.6409252, dae8f77e-2791-48e6-8803-d0660647ab18 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:20 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] VM Stopped (Lifecycle Event)
Jul 27 16:48:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-60e54201-8f9b-400d-95d8-153d5747bdf6 None None] [instance: dae8f77e-2791-48e6-8803-d0660647ab18] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:22 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:22 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:48:23 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'info_cache' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance destroyed successfully.
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'resources' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d5e45c-b2, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:25 user nova-compute[71026]: INFO os_vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:25 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec10682-e123-4f14-863b-6c76e5f3d182]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:48:25 user nova-compute[71026]: No targets found.
Jul 27 16:48:25 user nova-compute[71026]: iSNS:
Jul 27 16:48:25 user nova-compute[71026]: No targets found.
Jul 27 16:48:25 user nova-compute[71026]: STATIC:
Jul 27 16:48:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:48:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:48:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:48:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:25 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:48:25 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:25 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:25 user nova-compute[71026]: FIRMWARE:
Jul 27 16:48:25 user nova-compute[71026]: No targets found.
Jul 27 16:48:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:48:25 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:48:25 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef94743-5ba7-4b86-b5c1-2824550bd682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40821c3b-6799-4b1d-ac06-4954634e64d9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30886c1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11443b-a91a-46f0-8b18-4fe40aaf7597]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d1f79e-25a5-40fd-b5aa-368da9fdf3a5]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[640848a5-b0a9-4bd4-8cc9-f40d324533f7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cbfd23-291f-45b0-a17b-4ae0ea878b87]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e99ca-cbf6-425c-9462-f4c21f08544a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6365b205-42c6-4d98-881e-77efe26ecd55]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]
Jul 27 16:48:26 user nova-compute[71026]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=25.66791534423828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97004f56-737a-4746-a172-e769853a9bce]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.722s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== disconnect_volume: return (724ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start _get_guest_xml network_info=[{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '058360d9-5758-48f9-b528-ff08021b3ff4', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '95dcc9cc-42b0-413a-acd8-921a1197c8d9', 'attached_at': '', 'detached_at': '', 'volume_id': '350b6fba-6003-491a-acee-5c9399e8d086', 'serial': '350b6fba-6003-491a-acee-5c9399e8d086'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'numa_topology' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:26 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:26 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:26 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:26 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9c16cbdd-c74b-471f-acf9-232d88682f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed5a95e-8f17-47a3-b0c2-0ee2e5d24047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:48:26 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1735}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c66ca5-094f-4510-bbae-1b45e46f488a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086] added
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3d93d-842f-4f3d-8e38-7b891709ce20]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:26 user nova-compute[71026]: INFO nova.compute.manager [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Unshelving
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b924368-84ef-4d51-b781-2f568c99ad8c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhgOyGo {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vQhgOyGo" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74435acb-a9ae-4054-8540-cc2c34331f7c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vQhgOyGo'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901db15-3b49-4752-90f4-78bc74359a72]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f721972-9c73-40cf-9c33-b17e4dd3ccbd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: INFO nova.virt.block_device [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Booting with volume 37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 at /dev/vda
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c813e-7a36-4e61-a0a9-3412b90cb30d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]
Jul 27 16:48:26 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3141dd-7ef9-4cd6-b5e6-efe9875efcaa]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92fdada-0a78-41d1-b532-ef8384419de9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b249d-3438-4d43-bc4f-40a1238ae1df]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:26 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51862419-968e-42c6-bcd2-16985fd35872]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59324d-e648-402c-b8db-43eece66af37]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553d8b8-20db-4a51-962a-233058b5b0cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d9eb29-7a73-48f6-872c-41683d7ebe26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:48:26 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:48:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[978ea40e-641d-4c98-bc63-5210db984745]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:26 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating existing volume attachment record: 9873bb50-47fc-441d-b2d3-9f1b210e930b {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23230343831303764', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230343831303764', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'pci_devices' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:48:27 user nova-compute[71026]:   <uuid>95dcc9cc-42b0-413a-acd8-921a1197c8d9</uuid>
Jul 27 16:48:27 user nova-compute[71026]:   <name>instance-00000016</name>
Jul 27 16:48:27 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:48:27 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:48:27 user nova-compute[71026]:   <metadata>
Jul 27 16:48:27 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:48:27 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeTestJSON-server-904067667</nova:name>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:48:26</nova:creationTime>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:48:27 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:48:27 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:owner>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:user uuid="c543c6c138ad482ca985d5a756f78334">tempest-AttachVolumeTestJSON-2013998243-project-member</nova:user>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:project uuid="c4a20fd76c514ce488f9467e5ec36012">tempest-AttachVolumeTestJSON-2013998243</nova:project>
Jul 27 16:48:27 user nova-compute[71026]:       </nova:owner>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:48:27 user nova-compute[71026]:       <nova:ports>
Jul 27 16:48:27 user nova-compute[71026]:         <nova:port uuid="d4d5e45c-b26e-492f-9a92-f0bc0c120325">
Jul 27 16:48:27 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 16:48:27 user nova-compute[71026]:         </nova:port>
Jul 27 16:48:27 user nova-compute[71026]:       </nova:ports>
Jul 27 16:48:27 user nova-compute[71026]:     </nova:instance>
Jul 27 16:48:27 user nova-compute[71026]:   </metadata>
Jul 27 16:48:27 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:48:27 user nova-compute[71026]:     <system>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="serial">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="uuid">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:48:27 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:48:27 user nova-compute[71026]:     </system>
Jul 27 16:48:27 user nova-compute[71026]:   </sysinfo>
Jul 27 16:48:27 user nova-compute[71026]:   <os>
Jul 27 16:48:27 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:48:27 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:48:27 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:48:27 user nova-compute[71026]:   </os>
Jul 27 16:48:27 user nova-compute[71026]:   <features>
Jul 27 16:48:27 user nova-compute[71026]:     <acpi/>
Jul 27 16:48:27 user nova-compute[71026]:     <apic/>
Jul 27 16:48:27 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:48:27 user nova-compute[71026]:   </features>
Jul 27 16:48:27 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:48:27 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:48:27 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:48:27 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:48:27 user nova-compute[71026]:   </clock>
Jul 27 16:48:27 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:48:27 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:48:27 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:48:27 user nova-compute[71026]:   </cpu>
Jul 27 16:48:27 user nova-compute[71026]:   <devices>
Jul 27 16:48:27 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:48:27 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:48:27 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk"/>
Jul 27 16:48:27 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:48:27 user nova-compute[71026]:     </disk>
Jul 27 16:48:27 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:48:27 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:27 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:48:27 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:48:27 user nova-compute[71026]:       <serial>350b6fba-6003-491a-acee-5c9399e8d086</serial>
Jul 27 16:48:27 user nova-compute[71026]:     </disk>
Jul 27 16:48:27 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:48:27 user nova-compute[71026]:       <mac address="fa:16:3e:92:e9:89"/>
Jul 27 16:48:27 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:27 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:48:27 user nova-compute[71026]:       <target dev="tapd4d5e45c-b2"/>
Jul 27 16:48:27 user nova-compute[71026]:     </interface>
Jul 27 16:48:27 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:48:27 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/console.log" append="off"/>
Jul 27 16:48:27 user nova-compute[71026]:     </serial>
Jul 27 16:48:27 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:48:27 user nova-compute[71026]:     <video>
Jul 27 16:48:27 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:27 user nova-compute[71026]:     </video>
Jul 27 16:48:27 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:48:27 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:48:27 user nova-compute[71026]:     </rng>
Jul 27 16:48:27 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:48:27 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:48:27 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:48:27 user nova-compute[71026]:     </memballoon>
Jul 27 16:48:27 user nova-compute[71026]:   </devices>
Jul 27 16:48:27 user nova-compute[71026]: </domain>
Jul 27 16:48:27 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Cannot resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'migration_context' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG os_vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d5e45c-b2, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d5e45c-b2, col_values=(('external_ids', {'iface-id': 'd4d5e45c-b26e-492f-9a92-f0bc0c120325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e9:89', 'vm-uuid': '95dcc9cc-42b0-413a-acd8-921a1197c8d9'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:28 user nova-compute[71026]: INFO os_vif [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:48:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:29 user nova-compute[71026]: WARNING nova.compute.manager [req-d8d4c212-2b10-498e-948e-a6ce58b180e9 req-86b9a193-6ae3-407d-b400-4544a39f003a service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state powering-on.
Jul 27 16:48:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476511.7700462, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Resumed (Lifecycle Event)
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:48:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance rebooted successfully.
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b1cd7752-f6d3-4210-ba25-6cb4e5e8ea78 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476511.7714143, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:31 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Started (Lifecycle Event)
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:31 user nova-compute[71026]: WARNING nova.compute.manager [req-fa265a82-14f4-444b-95e8-63bc51d121b7 req-0b1af1b4-de39-408a-b378-52844fbfb1f9 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state active and task_state None.
Jul 27 16:48:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'pci_requests' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'numa_topology' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:48:34 user nova-compute[71026]: INFO nova.compute.claims [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Claim successful on node user
Jul 27 16:48:34 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:48:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:34 user nova-compute[71026]: INFO nova.network.neutron [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating port 42e5797d-04b4-454d-98de-385c51ca70f2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing instance network info cache due to event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:48:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:48:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Creating image(s)
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Ensure instance console log exists: /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start _get_guest_xml network_info=[{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9873bb50-47fc-441d-b2d3-9f1b210e930b', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1', 'attached_at': '', 'detached_at': '', 'volume_id': '37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'serial': '37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:48:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'vcpu_model' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:36 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37831862-22d4-4a74-bb9b-da768d49650c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:48:36 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ebea25-3f68-4815-9a68-aee9189b56b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312] added
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c1a37-f582-42a2-85b2-593dadc43647]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93b398-1b15-4d62-bfd9-f21f4aee11e0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDJbanSk {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDJbanSk" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efcde3b-fc6e-4edd-92cb-e761496121de]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDJbanSk'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e1f61a-6628-40c6-9b67-8151cb9501ea]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c55e0-bf30-405d-bacb-30b12c56db25]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a894d-fc54-4cc5-919b-f519a1b1ca7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]
Jul 27 16:48:36 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b2e61-84fc-4029-8a87-91f6bf004c34]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a37a16-6056-4aff-8a38-cdad9694694a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a7bb98-8b0d-4d00-a227-9cc48ababbcc]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updated VIF entry in instance network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0beeca67-831f-4054-bbd9-10aabc17d318 req-7923aedc-7b00-4a2e-9fb4-0683915071c1 service nova] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23139666639646637', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139666639646637', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1110890233',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:48:26Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:48:37 user nova-compute[71026]:   <uuid>56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</uuid>
Jul 27 16:48:37 user nova-compute[71026]:   <name>instance-00000017</name>
Jul 27 16:48:37 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:48:37 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:48:37 user nova-compute[71026]:   <metadata>
Jul 27 16:48:37 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:48:37 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:48:37 user nova-compute[71026]:       <nova:name>tempest-TestShelveInstance-server-893891946</nova:name>
Jul 27 16:48:37 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:48:36</nova:creationTime>
Jul 27 16:48:37 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:48:37 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:48:37 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:48:37 user nova-compute[71026]:       <nova:owner>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:user uuid="65274ecb1cb84995a5ab9d43e315ac2a">tempest-TestShelveInstance-697106287-project-member</nova:user>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:project uuid="e3d01c4091154135a4fab0a817e406c3">tempest-TestShelveInstance-697106287</nova:project>
Jul 27 16:48:37 user nova-compute[71026]:       </nova:owner>
Jul 27 16:48:37 user nova-compute[71026]:       <nova:ports>
Jul 27 16:48:37 user nova-compute[71026]:         <nova:port uuid="42e5797d-04b4-454d-98de-385c51ca70f2">
Jul 27 16:48:37 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:48:37 user nova-compute[71026]:         </nova:port>
Jul 27 16:48:37 user nova-compute[71026]:       </nova:ports>
Jul 27 16:48:37 user nova-compute[71026]:     </nova:instance>
Jul 27 16:48:37 user nova-compute[71026]:   </metadata>
Jul 27 16:48:37 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:48:37 user nova-compute[71026]:     <system>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="serial">56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</entry>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="uuid">56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1</entry>
Jul 27 16:48:37 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:48:37 user nova-compute[71026]:     </system>
Jul 27 16:48:37 user nova-compute[71026]:   </sysinfo>
Jul 27 16:48:37 user nova-compute[71026]:   <os>
Jul 27 16:48:37 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:48:37 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:48:37 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:48:37 user nova-compute[71026]:   </os>
Jul 27 16:48:37 user nova-compute[71026]:   <features>
Jul 27 16:48:37 user nova-compute[71026]:     <acpi/>
Jul 27 16:48:37 user nova-compute[71026]:     <apic/>
Jul 27 16:48:37 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:48:37 user nova-compute[71026]:   </features>
Jul 27 16:48:37 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:48:37 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:48:37 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:48:37 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:48:37 user nova-compute[71026]:   </clock>
Jul 27 16:48:37 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:48:37 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:48:37 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:48:37 user nova-compute[71026]:   </cpu>
Jul 27 16:48:37 user nova-compute[71026]:   <devices>
Jul 27 16:48:37 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:48:37 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:37 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:48:37 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:48:37 user nova-compute[71026]:       <serial>37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312</serial>
Jul 27 16:48:37 user nova-compute[71026]:     </disk>
Jul 27 16:48:37 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:48:37 user nova-compute[71026]:       <mac address="fa:16:3e:74:c4:81"/>
Jul 27 16:48:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:37 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:48:37 user nova-compute[71026]:       <target dev="tap42e5797d-04"/>
Jul 27 16:48:37 user nova-compute[71026]:     </interface>
Jul 27 16:48:37 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:48:37 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1/console.log" append="off"/>
Jul 27 16:48:37 user nova-compute[71026]:     </serial>
Jul 27 16:48:37 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:48:37 user nova-compute[71026]:     <video>
Jul 27 16:48:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:48:37 user nova-compute[71026]:     </video>
Jul 27 16:48:37 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:48:37 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:48:37 user nova-compute[71026]:     </rng>
Jul 27 16:48:37 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:48:37 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:48:37 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:48:37 user nova-compute[71026]:     </memballoon>
Jul 27 16:48:37 user nova-compute[71026]:   </devices>
Jul 27 16:48:37 user nova-compute[71026]: </domain>
Jul 27 16:48:37 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1110890233',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:48:26Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG os_vif [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42e5797d-04, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42e5797d-04, col_values=(('external_ids', {'iface-id': '42e5797d-04b4-454d-98de-385c51ca70f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c4:81', 'vm-uuid': '56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:37 user nova-compute[71026]: INFO os_vif [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04')
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:48:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] No VIF found with MAC fa:16:3e:74:c4:81, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:48:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:38 user nova-compute[71026]: INFO nova.compute.manager [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Detaching volume f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:48:38 user nova-compute[71026]: INFO nova.virt.block_device [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Attempting to driver detach volume f9ba50b9-ef83-4efa-8ff7-084ffda6b272 from mountpoint /dev/vdb
Jul 27 16:48:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Attempting to detach device vdb from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:48:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:48:38 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:38 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 16:48:38 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:48:38 user nova-compute[71026]:   <serial>f9ba50b9-ef83-4efa-8ff7-084ffda6b272</serial>
Jul 27 16:48:38 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:48:38 user nova-compute[71026]: </disk>
Jul 27 16:48:38 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:48:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully detached device vdb from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the persistent domain config.
Jul 27 16:48:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:48:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:48:38 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:38 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 16:48:38 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:48:38 user nova-compute[71026]:   <serial>f9ba50b9-ef83-4efa-8ff7-084ffda6b272</serial>
Jul 27 16:48:38 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:48:38 user nova-compute[71026]: </disk>
Jul 27 16:48:38 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:39 user nova-compute[71026]: WARNING nova.compute.manager [req-c7df5caf-0c5b-4e87-82d8-b9690b3ab9cd req-c0dbc78c-065c-4be3-939f-692a120568b3 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476519.352484, 9c16cbdd-c74b-471f-acf9-232d88682f2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:48:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully detached device vdb from instance 9c16cbdd-c74b-471f-acf9-232d88682f2e from the live domain config.
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lpEvFDIX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:39 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae83512-4922-4566-b180-fc5ac0941550]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:48:39 user nova-compute[71026]: No targets found.
Jul 27 16:48:39 user nova-compute[71026]: iSNS:
Jul 27 16:48:39 user nova-compute[71026]: No targets found.
Jul 27 16:48:39 user nova-compute[71026]: STATIC:
Jul 27 16:48:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:48:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272
Jul 27 16:48:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:48:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:48:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:48:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:39 user nova-compute[71026]: FIRMWARE:
Jul 27 16:48:39 user nova-compute[71026]: No targets found.
Jul 27 16:48:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:48:39 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:48:39 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f05ff-eeaf-403c-a4fa-d232807e9572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2633f59e-12b0-43d6-850f-1acb7f6d7aa0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a82284c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272'): ({'sdf'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Removing single pathed devices sdf {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5aa402-bb36-4518-a440-99e1d65831e9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf8d9a-23b7-4ccc-9da7-99892d464dff]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Flushing IO for device /dev/sdf {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87d40cc-730f-436c-9402-bc084d202c0d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070c5b9-1a1d-44d7-a892-fcd93eb4ee30]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77474f84-b5d3-48b3-9384-54672d8b3c06]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5b162-6ac9-444f-b4cd-d5d1fd6cc476]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260]
Jul 27 16:48:39 user nova-compute[71026]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9ba50b9-ef83-4efa-8ff7-084ffda6b272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c23e57-c915-41cf-aeb6-af29d3529108]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] <== disconnect_volume: return (431ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:48:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'flavor' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ac8164b-eecb-49c6-b36d-9ac2badc211c tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.216s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:41 user nova-compute[71026]: WARNING nova.compute.manager [req-0e280a41-0bcd-45e9-9c77-90c193fd522e req-365c286e-afe4-4f24-afe0-2fdfaf29960b service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476521.57688, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Resumed (Lifecycle Event)
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:48:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance spawned successfully.
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476521.5780785, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:48:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Started (Lifecycle Event)
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:48:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-503a07f0-e900-4a94-b4da-36ae3c6aedc8 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.300s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing instance network info cache due to event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updated VIF entry in instance network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.network.neutron [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b250f49-07f4-45dd-b6a5-a67aed7d1eb5 req-f94a02a0-770b-4cac-b39a-cb229eb509b6 service nova] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:45 user nova-compute[71026]: INFO nova.compute.manager [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Detaching volume a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:48:45 user nova-compute[71026]: INFO nova.virt.block_device [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Attempting to driver detach volume a340af56-ef04-45a3-92ac-6d7d37ecd4d4 from mountpoint /dev/vdb
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Attempting to detach device vdb from instance 3550a85d-ed4d-4728-8398-23a171e6f40d from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:48:45 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:45 user nova-compute[71026]:   <source dev="/dev/sde"/>
Jul 27 16:48:45 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:48:45 user nova-compute[71026]:   <serial>a340af56-ef04-45a3-92ac-6d7d37ecd4d4</serial>
Jul 27 16:48:45 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:48:45 user nova-compute[71026]: </disk>
Jul 27 16:48:45 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:48:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully detached device vdb from instance 3550a85d-ed4d-4728-8398-23a171e6f40d from the persistent domain config.
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3550a85d-ed4d-4728-8398-23a171e6f40d from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:48:45 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:48:45 user nova-compute[71026]:   <source dev="/dev/sde"/>
Jul 27 16:48:45 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:48:45 user nova-compute[71026]:   <serial>a340af56-ef04-45a3-92ac-6d7d37ecd4d4</serial>
Jul 27 16:48:45 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:48:45 user nova-compute[71026]: </disk>
Jul 27 16:48:45 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476525.9589748, 3550a85d-ed4d-4728-8398-23a171e6f40d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:48:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully detached device vdb from instance 3550a85d-ed4d-4728-8398-23a171e6f40d from the live domain config.
Jul 27 16:48:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuaOfBmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:48:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:48:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45bb76-9143-4fcf-a72d-7758995d674a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:48:45 user nova-compute[71026]: No targets found.
Jul 27 16:48:45 user nova-compute[71026]: iSNS:
Jul 27 16:48:45 user nova-compute[71026]: No targets found.
Jul 27 16:48:45 user nova-compute[71026]: STATIC:
Jul 27 16:48:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:48:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4
Jul 27 16:48:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:48:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:48:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:48:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:48:45 user nova-compute[71026]: FIRMWARE:
Jul 27 16:48:45 user nova-compute[71026]: No targets found.
Jul 27 16:48:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:48:46 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:48:46 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3046d374-39e7-4297-ae62-93b48ce097d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e9ffae-5365-4e7e-963a-3bcda74697a2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:48:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088350dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4'): ({'sde'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Removing single pathed devices sde {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f588612-ef1b-41f8-bbc0-de5b6ed7e7b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1578bdd-226e-4eba-8ddb-3e1257ffcc0d]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Flushing IO for device /dev/sde {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83375f-e6da-48e5-aa32-d21979216a09]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0fd61e-ffeb-42cc-99d2-597476ea8be0]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df1f6e7-02c8-4b0a-91fa-03bc1db3eb07]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fe20a7-86c3-41a0-82c4-91dadbd05755]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260]
Jul 27 16:48:46 user nova-compute[71026]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4, portal: 172.16.0.220,3260] successful.
Jul 27 16:48:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a340af56-ef04-45a3-92ac-6d7d37ecd4d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b304e-77da-4079-ae25-83862da7fa13]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] <== disconnect_volume: return (341ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing instance network info cache due to event network-changed-8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:48:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Refreshing network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'flavor' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-819db5a4-a362-414d-a5f5-eb32b327aea7 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updated VIF entry in instance network info cache for port 8f907dad-0ec6-4443-83df-f6a5ad7b811d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab3e1441-6467-41c2-b473-cee2a7d4cd49 req-9d8e0bba-0023-403d-b65b-9711ad2bf63f service nova] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:48:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:56 user nova-compute[71026]: INFO nova.compute.manager [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Terminating instance
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-unplugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] No waiting events found dispatching network-vif-unplugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-82ce59be-a00f-494f-9024-ddb41c8aabc5 req-b618bd7f-b771-44e7-9ccd-eb80c6dc16ac service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-unplugged-e396e883-942f-4131-bcbb-32e5cc866b74 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Instance destroyed successfully.
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.objects.instance [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lazy-loading 'resources' on Instance uuid 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-173889736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-173889736',id=19,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp85++5OPICJthV8A8wWUohVMrvaeNitOY0af18cclBiKAvf5A5+kSBzjsdT3VJjNDKlUZ1RVNRSJ5Q7aFDovxMjwL9TjnPMEv/bhOjkYL9Q2chZVRnLuK67kQZkHnBIw==',key_name='tempest-keypair-1113239109',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dac247d812f44c28c003f764b784304',ramdisk_id='',reservation_id='r-dddadlyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-510559864',owner_user_name='tempest-ServerActionsV293TestJSON-510559864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='072754b24f114dea8b70d8ce6370d7e3',uuid=7aadd7d4-35d1-4dea-98b3-26c1c1f46de8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converting VIF {"id": "e396e883-942f-4131-bcbb-32e5cc866b74", "address": "fa:16:3e:f5:ec:ea", "network": {"id": "9617fb4a-6fb3-4540-ab45-da8fc44b1438", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1238247733-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dac247d812f44c28c003f764b784304", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape396e883-94", "ovs_interfaceid": "e396e883-942f-4131-bcbb-32e5cc866b74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG os_vif [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape396e883-94, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:48:56 user nova-compute[71026]: INFO os_vif [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ec:ea,bridge_name='br-int',has_traffic_filtering=True,id=e396e883-942f-4131-bcbb-32e5cc866b74,network=Network(9617fb4a-6fb3-4540-ab45-da8fc44b1438),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape396e883-94')
Jul 27 16:48:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Deleting instance files /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8_del
Jul 27 16:48:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Deletion of /opt/stack/data/nova/instances/7aadd7d4-35d1-4dea-98b3-26c1c1f46de8_del complete
Jul 27 16:48:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:48:56 user nova-compute[71026]: INFO nova.compute.manager [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 27 16:48:56 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:48:56 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:48:57 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:48:57 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Took 0.84 seconds to deallocate network for instance.
Jul 27 16:48:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-43fb035b-72e7-4a2a-b19a-9236f26cb7fa req-57456a87-948e-4c8e-a215-fc7d74877255 service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-deleted-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:58 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Deleted allocations for instance 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8
Jul 27 16:48:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-ffe06c6b-bf26-44bf-8ce2-9b59336d3f95 tempest-ServerActionsV293TestJSON-510559864 tempest-ServerActionsV293TestJSON-510559864-project-member] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] Acquiring lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] Lock "7aadd7d4-35d1-4dea-98b3-26c1c1f46de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:48:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] No waiting events found dispatching network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:48:58 user nova-compute[71026]: WARNING nova.compute.manager [req-7a973713-2698-48d9-952f-a7fafe112cd6 req-63275e3d-610a-49bc-8080-8b4fd1f7c8be service nova] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Received unexpected event network-vif-plugged-e396e883-942f-4131-bcbb-32e5cc866b74 for instance with vm_state deleted and task_state None.
Jul 27 16:48:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:49:02 user nova-compute[71026]: INFO nova.compute.claims [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Claim successful on node user
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:49:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:49:02 user nova-compute[71026]: INFO nova.virt.block_device [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Booting with volume 2274621d-842d-4f87-a14c-b19d66a2c83c at /dev/vda
Jul 27 16:49:02 user nova-compute[71026]: DEBUG nova.policy [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG os_brick.utils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f688ee25-f02c-4c3c-b444-7a42cd16a3a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7f6bc-6b3f-435a-aadb-6423d90f84b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3031c96-010e-4702-9e79-7040efe46d5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e56453-a159-4dc3-99b2-dd1fb32fefe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:49:03 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:49:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e43e9-1c02-472b-9c18-800cd59eb070]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG os_brick.utils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating existing volume attachment record: a1d63fbc-8ace-4684-9384-dc9339ba1e72 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:49:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Successfully created port: 721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Successfully updated port: 721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-changed-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Refreshing instance network info cache due to event network-changed-721c9544-64e0-447e-b6e7-d0d63e258060. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] Acquiring lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating instance_info_cache with network_info: [{"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Instance network_info: |[{"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] Acquired lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG nova.network.neutron [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Refreshing network info cache for port 721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG nova.network.neutron [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updated VIF entry in instance network info cache for port 721c9544-64e0-447e-b6e7-d0d63e258060. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG nova.network.neutron [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating instance_info_cache with network_info: [{"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-53e16ab1-dd2c-43d2-ae90-a943f9a026fe req-351ccffb-8ce6-4301-8a9d-484c8f12803f service nova] Releasing lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:49:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Creating image(s)
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Ensure instance console log exists: /opt/stack/data/nova/instances/bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Start _get_guest_xml network_info=[{"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1d63fbc-8ace-4684-9384-dc9339ba1e72', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNrfJqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24', 'attached_at': '', 'detached_at': '', 'volume_id': '2274621d-842d-4f87-a14c-b19d66a2c83c', 'serial': '2274621d-842d-4f87-a14c-b19d66a2c83c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:49:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:49:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNrfJqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:49:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:49:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:49:10 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd8256-9fbd-4052-be56-4786e6ecfdd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:49:10 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5a953-363f-451a-8b31-68b9bb7860a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c] added
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6fa7c-2530-4e7a-a205-51aada011c18]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09679d-446c-42be-9e13-a28385327ae1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbNrfJqL {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbNrfJqL" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf1fa2-fc87-42e1-8555-09248ad8c216]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbNrfJqL'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73354863-9a04-4eb5-ac91-2d635c3aaed6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cf753a-2608-4ee0-bd1c-7f3b38f8e65b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8451859c-a67a-4038-9ab3-d0a0463f8d3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260]
Jul 27 16:49:10 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260] successful.
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[774421aa-a6be-4977-815a-0179e66c9816]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1fc8d-de2f-4d4a-b575-6654a1d93180]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:10 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:49:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8b6e38-1de4-452e-9e25-87d2d164396c]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNrfJqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23831643233396363', 'path': '/dev/sde'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831643233396363', 'path': '/dev/sde'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-346459254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-346459254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-346459254',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTv8s0XmlWaqzVsbwWNm4z/rQe8L4o9Z23JaTvQ0oEIyLfFkzLUKJ9JXigJ366ZseT+sHm/zysYOd9LFEmZTgL93PRJabmQQiFqjnOBPvHix0WhBPLLifFX3kfwM6c7tg==',key_name='tempest-keypair-2144241389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-d7iohvk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476536.827226, 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:49:11 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] VM Stopped (Lifecycle Event)
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:49:11 user nova-compute[71026]:   <uuid>bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24</uuid>
Jul 27 16:49:11 user nova-compute[71026]:   <name>instance-0000001b</name>
Jul 27 16:49:11 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:49:11 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:49:11 user nova-compute[71026]:   <metadata>
Jul 27 16:49:11 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:49:11 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:49:11 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-346459254</nova:name>
Jul 27 16:49:11 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:49:10</nova:creationTime>
Jul 27 16:49:11 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:49:11 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:49:11 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:49:11 user nova-compute[71026]:       <nova:owner>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:49:11 user nova-compute[71026]:       </nova:owner>
Jul 27 16:49:11 user nova-compute[71026]:       <nova:ports>
Jul 27 16:49:11 user nova-compute[71026]:         <nova:port uuid="721c9544-64e0-447e-b6e7-d0d63e258060">
Jul 27 16:49:11 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:49:11 user nova-compute[71026]:         </nova:port>
Jul 27 16:49:11 user nova-compute[71026]:       </nova:ports>
Jul 27 16:49:11 user nova-compute[71026]:     </nova:instance>
Jul 27 16:49:11 user nova-compute[71026]:   </metadata>
Jul 27 16:49:11 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:49:11 user nova-compute[71026]:     <system>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="serial">bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24</entry>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="uuid">bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24</entry>
Jul 27 16:49:11 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:49:11 user nova-compute[71026]:     </system>
Jul 27 16:49:11 user nova-compute[71026]:   </sysinfo>
Jul 27 16:49:11 user nova-compute[71026]:   <os>
Jul 27 16:49:11 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:49:11 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:49:11 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:49:11 user nova-compute[71026]:   </os>
Jul 27 16:49:11 user nova-compute[71026]:   <features>
Jul 27 16:49:11 user nova-compute[71026]:     <acpi/>
Jul 27 16:49:11 user nova-compute[71026]:     <apic/>
Jul 27 16:49:11 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:49:11 user nova-compute[71026]:   </features>
Jul 27 16:49:11 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:49:11 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:49:11 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:49:11 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:49:11 user nova-compute[71026]:   </clock>
Jul 27 16:49:11 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:49:11 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:49:11 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:49:11 user nova-compute[71026]:   </cpu>
Jul 27 16:49:11 user nova-compute[71026]:   <devices>
Jul 27 16:49:11 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:49:11 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:49:11 user nova-compute[71026]:       <source dev="/dev/sde"/>
Jul 27 16:49:11 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:49:11 user nova-compute[71026]:       <serial>2274621d-842d-4f87-a14c-b19d66a2c83c</serial>
Jul 27 16:49:11 user nova-compute[71026]:     </disk>
Jul 27 16:49:11 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:49:11 user nova-compute[71026]:       <mac address="fa:16:3e:35:3d:4a"/>
Jul 27 16:49:11 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:49:11 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:49:11 user nova-compute[71026]:       <target dev="tap721c9544-64"/>
Jul 27 16:49:11 user nova-compute[71026]:     </interface>
Jul 27 16:49:11 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:49:11 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24/console.log" append="off"/>
Jul 27 16:49:11 user nova-compute[71026]:     </serial>
Jul 27 16:49:11 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:49:11 user nova-compute[71026]:     <video>
Jul 27 16:49:11 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:49:11 user nova-compute[71026]:     </video>
Jul 27 16:49:11 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:49:11 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:49:11 user nova-compute[71026]:     </rng>
Jul 27 16:49:11 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:49:11 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:49:11 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:49:11 user nova-compute[71026]:     </memballoon>
Jul 27 16:49:11 user nova-compute[71026]:   </devices>
Jul 27 16:49:11 user nova-compute[71026]: </domain>
Jul 27 16:49:11 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-346459254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-346459254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-346459254',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTv8s0XmlWaqzVsbwWNm4z/rQe8L4o9Z23JaTvQ0oEIyLfFkzLUKJ9JXigJ366ZseT+sHm/zysYOd9LFEmZTgL93PRJabmQQiFqjnOBPvHix0WhBPLLifFX3kfwM6c7tg==',key_name='tempest-keypair-2144241389',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-d7iohvk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG os_vif [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-623fc3a2-02f9-4169-963a-24cf9f55176b None None] [instance: 7aadd7d4-35d1-4dea-98b3-26c1c1f46de8] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap721c9544-64, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap721c9544-64, col_values=(('external_ids', {'iface-id': '721c9544-64e0-447e-b6e7-d0d63e258060', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:3d:4a', 'vm-uuid': 'bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:11 user nova-compute[71026]: INFO os_vif [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64')
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:49:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:35:3d:4a, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] No waiting events found dispatching network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:13 user nova-compute[71026]: WARNING nova.compute.manager [req-4fe19c18-dd8c-4d7c-ae1f-231dc38cf374 req-23b9d53e-cbea-40b5-8d0b-b8406bc4eeaa service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received unexpected event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 for instance with vm_state building and task_state spawning.
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476555.2709985, bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] VM Resumed (Lifecycle Event)
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Instance spawned successfully.
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476555.274249, bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] VM Started (Lifecycle Event)
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Took 5.00 seconds to spawn the instance on the hypervisor.
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:15 user nova-compute[71026]: INFO nova.compute.manager [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Took 13.15 seconds to build instance.
Jul 27 16:49:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f26e4954-0a83-4da0-b7dc-96530c7b6e3c tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.244s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:15 user nova-compute[71026]: DEBUG nova.compute.manager [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] No waiting events found dispatching network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:15 user nova-compute[71026]: WARNING nova.compute.manager [req-8d2abfd9-9f00-47cc-912e-35d14ed0c5f4 req-3b21ec4c-8634-4ba6-8593-64cce37a0338 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received unexpected event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 for instance with vm_state active and task_state None.
Jul 27 16:49:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:19 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:49:27 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:49:27 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:49:27 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=25.68315887451172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3550a85d-ed4d-4728-8398-23a171e6f40d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9c16cbdd-c74b-471f-acf9-232d88682f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:28 user nova-compute[71026]: INFO nova.compute.manager [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Terminating instance
Jul 27 16:49:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-unplugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] No waiting events found dispatching network-vif-unplugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-faf1a0c4-7666-4ae0-93d1-0ccb84df61c8 req-2e0ee762-8a6a-4dbb-98b2-9a5971de9fae service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-unplugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:49:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Instance destroyed successfully.
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lazy-loading 'resources' on Instance uuid 9c16cbdd-c74b-471f-acf9-232d88682f2e {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:45:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-296855908',display_name='tempest-TestServerVolumeAttachmentScenario-server-296855908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-296855908',id=24,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx6UCK7J2te/k4rOnuGO7R0HwISeat6Wb32EW1nnNtCSvRtHcn4LYHzgAGykaBzy8SWxX//6e++0ZHUhApYQw72LJG3S046QluKOKHozCG7ifeKq6up5MHIBSAaUdB5mQ==',key_name='tempest-keypair-1063992593',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='351160478929495bb63cb9c9ac562a72',ramdisk_id='',reservation_id='r-eeul353d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-224674346',owner_user_name='tempest-TestServerVolumeAttachmentScenario-224674346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cdef212322604675b67d86e73ab0878a',uuid=9c16cbdd-c74b-471f-acf9-232d88682f2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converting VIF {"id": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "address": "fa:16:3e:b1:dd:19", "network": {"id": "1509f5bc-1b84-4ae9-b885-e39759a43941", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1930334086-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "351160478929495bb63cb9c9ac562a72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddac2e8f-8e", "ovs_interfaceid": "ddac2e8f-8e32-42aa-99b3-d8f1cbec145a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG os_vif [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddac2e8f-8e, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:49:29 user nova-compute[71026]: INFO os_vif [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:dd:19,bridge_name='br-int',has_traffic_filtering=True,id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a,network=Network(1509f5bc-1b84-4ae9-b885-e39759a43941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddac2e8f-8e')
Jul 27 16:49:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Deleting instance files /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e_del
Jul 27 16:49:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Deletion of /opt/stack/data/nova/instances/9c16cbdd-c74b-471f-acf9-232d88682f2e_del complete
Jul 27 16:49:30 user nova-compute[71026]: INFO nova.compute.manager [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Took 1.05 seconds to destroy the instance on the hypervisor.
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [{"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-3550a85d-ed4d-4728-8398-23a171e6f40d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:30 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Took 0.83 seconds to deallocate network for instance.
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-df85da4b-8d3f-489b-858c-8aeb817c5903 req-24d0f322-383a-45e6-aba4-838b9d08a579 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-deleted-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:30 user nova-compute[71026]: INFO nova.compute.manager [req-df85da4b-8d3f-489b-858c-8aeb817c5903 req-24d0f322-383a-45e6-aba4-838b9d08a579 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Neutron deleted interface ddac2e8f-8e32-42aa-99b3-d8f1cbec145a; detaching it from the instance and deleting it from the info cache
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-df85da4b-8d3f-489b-858c-8aeb817c5903 req-24d0f322-383a-45e6-aba4-838b9d08a579 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-df85da4b-8d3f-489b-858c-8aeb817c5903 req-24d0f322-383a-45e6-aba4-838b9d08a579 service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Detach interface failed, port_id=ddac2e8f-8e32-42aa-99b3-d8f1cbec145a, reason: Instance 9c16cbdd-c74b-471f-acf9-232d88682f2e could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:31 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Deleted allocations for instance 9c16cbdd-c74b-471f-acf9-232d88682f2e
Jul 27 16:49:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dcdc1ec2-57f1-4c19-8497-bcdf030f6329 tempest-TestServerVolumeAttachmentScenario-224674346 tempest-TestServerVolumeAttachmentScenario-224674346-project-member] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] Acquiring lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] Lock "9c16cbdd-c74b-471f-acf9-232d88682f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] No waiting events found dispatching network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:31 user nova-compute[71026]: WARNING nova.compute.manager [req-9ebb3353-cd3f-4c9a-869d-3ecc53e8cd4f req-24c49c92-bba4-4fa3-83ab-96055e449eec service nova] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Received unexpected event network-vif-plugged-ddac2e8f-8e32-42aa-99b3-d8f1cbec145a for instance with vm_state deleted and task_state None.
Jul 27 16:49:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:35 user nova-compute[71026]: INFO nova.compute.manager [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Terminating instance
Jul 27 16:49:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-66a1dcc3-413c-4c78-bd21-24639a897be0 req-accf6efd-1431-46cb-8657-ed04dc88745e service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-unplugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:49:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Instance destroyed successfully.
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid 3550a85d-ed4d-4728-8398-23a171e6f40d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-244159089',display_name='tempest-ServerRescueNegativeTestJSON-server-244159089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-244159089',id=20,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbVZbxraV9LLAYbitENvm7qE5uy+asL3RJ5zJAybGKiBTF8Cdyko5Af5r0bkNToPHY27EbQT7Kx7HbEjndoXMvYFbm0Z4E7mhy1JznNARq3v1wSjZFDVJ/NWdB1AypIPA==',key_name='tempest-keypair-1386888906',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-f67li0gv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421dd87102724509a506e368de55faaf',uuid=3550a85d-ed4d-4728-8398-23a171e6f40d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "address": "fa:16:3e:2b:2b:8e", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f907dad-0e", "ovs_interfaceid": "8f907dad-0ec6-4443-83df-f6a5ad7b811d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG os_vif [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f907dad-0e, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:49:36 user nova-compute[71026]: INFO os_vif [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2b:8e,bridge_name='br-int',has_traffic_filtering=True,id=8f907dad-0ec6-4443-83df-f6a5ad7b811d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f907dad-0e')
Jul 27 16:49:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Deleting instance files /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d_del
Jul 27 16:49:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Deletion of /opt/stack/data/nova/instances/3550a85d-ed4d-4728-8398-23a171e6f40d_del complete
Jul 27 16:49:36 user nova-compute[71026]: INFO nova.compute.manager [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 16:49:36 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:49:36 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:49:37 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:37 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Took 1.07 seconds to deallocate network for instance.
Jul 27 16:49:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-f1c89999-fd3b-4c77-bac2-5a13f1b713ac req-636194e3-be78-44c1-9ebd-f49c843e0ce5 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-deleted-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:38 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Deleted allocations for instance 3550a85d-ed4d-4728-8398-23a171e6f40d
Jul 27 16:49:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] Acquiring lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] No waiting events found dispatching network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:38 user nova-compute[71026]: WARNING nova.compute.manager [req-d9ac6ac6-224a-487e-add9-c6395508c846 req-2dd1fef3-077b-45bc-a001-897e52f70056 service nova] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Received unexpected event network-vif-plugged-8f907dad-0ec6-4443-83df-f6a5ad7b811d for instance with vm_state deleted and task_state None.
Jul 27 16:49:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c65d8e23-5c23-430e-b0a3-040fae6981ac tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "3550a85d-ed4d-4728-8398-23a171e6f40d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.506s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:44 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476569.899237, 9c16cbdd-c74b-471f-acf9-232d88682f2e => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:49:44 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] VM Stopped (Lifecycle Event)
Jul 27 16:49:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2425c26e-e3f5-4b0f-9d05-b6c377e1588a None None] [instance: 9c16cbdd-c74b-471f-acf9-232d88682f2e] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-changed-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing instance network info cache due to event network-changed-edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:49:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:49 user nova-compute[71026]: DEBUG nova.network.neutron [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Refreshing network info cache for port edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:49:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated VIF entry in instance network info cache for port edd92f92-526b-4110-9219-7dce34224f86. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:49:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6fd5f4e0-a976-41d2-954d-65cce4da293a req-caffca02-6411-4580-87be-38cb89aea7c9 service nova] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Stashing vm_state: active {{(pid=71026) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_requests' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:49:51 user nova-compute[71026]: INFO nova.compute.claims [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Claim successful on node user
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'resources' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:49:51 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating resource usage from migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-changed-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Refreshing instance network info cache due to event network-changed-16e29a1c-b62b-48b5-88d5-0666f4d72b5f. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Refreshing network info cache for port 16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476576.521117, 3550a85d-ed4d-4728-8398-23a171e6f40d => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:49:51 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] VM Stopped (Lifecycle Event)
Jul 27 16:49:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3e69c88f-961e-41f2-88cb-72f42cc61c9f None None] [instance: 3550a85d-ed4d-4728-8398-23a171e6f40d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.369s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:51 user nova-compute[71026]: INFO nova.compute.manager [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Migrating
Jul 27 16:49:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updated VIF entry in instance network info cache for port 16e29a1c-b62b-48b5-88d5-0666f4d72b5f. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-78a4c157-d350-40aa-a691-0b3b3c886b07 req-437ae0ef-ee99-4a2d-b6be-1b79343ece23 service nova] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Starting migrate_disk_and_power_off {{(pid=71026) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:53 user nova-compute[71026]: WARNING nova.compute.manager [req-2a2259f2-619d-4915-8058-88f047c2c520 req-fede7220-dd6f-4e0c-adc9-05116a371b72 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state active and task_state resize_migrating.
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:53 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance destroyed successfully.
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16e29a1c-b6, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:49:53 user nova-compute[71026]: INFO os_vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6')
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:49:53 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e719c30e-725b-4066-ad80-a3cb46508d15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:49:53 user nova-compute[71026]: No targets found.
Jul 27 16:49:53 user nova-compute[71026]: iSNS:
Jul 27 16:49:53 user nova-compute[71026]: No targets found.
Jul 27 16:49:53 user nova-compute[71026]: STATIC:
Jul 27 16:49:53 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:49:53 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:49:53 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:49:53 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c
Jul 27 16:49:53 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:49:53 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:49:53 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:49:53 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:49:53 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:49:53 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:49:53 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:49:53 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:49:53 user nova-compute[71026]: FIRMWARE:
Jul 27 16:49:53 user nova-compute[71026]: No targets found.
Jul 27 16:49:53 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:49:53 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:49:53 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196ee15-9024-4af0-bbe9-13e29efd47fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcaddf6-11af-4966-870e-36c0c59c457a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:49:53 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:49:53 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:49:53 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308868c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e33435-23c4-4261-8e95-9035ad3a88e0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1709fb-36e5-4ec6-bec1-f9f1b39df903]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6cbf00-b315-4677-8d84-4622fdad9783]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b012b88e-ea46-4bbb-9b0d-8ce33305ccd7]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc383074a-b471862727d27515',) {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:49:53 user nova-compute[71026]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc383074a-b471862727d27515
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a920c8-a6df-4913-9f19-42cc3d6620a2]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a32a2c-4297-4945-807d-b2041aa23180]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f678faa-e7e8-4b47-ac29-50b2780e3e8c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]
Jul 27 16:49:53 user nova-compute[71026]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.
Jul 27 16:49:53 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5a450-446d-4632-892d-92c83ff34861]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== disconnect_volume: return (318ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:49:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:49:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Port 16e29a1c-b62b-48b5-88d5-0666f4d72b5f binding to destination host user is already ACTIVE {{(pid=71026) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:49:55 user nova-compute[71026]: WARNING nova.compute.manager [req-2091fd05-f4ca-445d-a548-866bf0ca14a6 req-59075789-ce12-4fce-afdc-78bdae9eff34 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state active and task_state resize_migrated.
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.utils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca388f62-f788-4b71-bc63-85131f93839f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92329d98-a408-4f07-8961-2da0919f7f2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8e471a-eebe-45b4-a296-561452dd86ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c975445-6fda-4ce9-a011-114a97a5b8cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:49:55 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:49:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e2053b-367c-4d6d-8787-94c01ce7c688]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:49:55 user nova-compute[71026]: DEBUG os_brick.utils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:49:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:49:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:50:01 user nova-compute[71026]: INFO nova.compute.claims [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Claim successful on node user
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:50:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.policy [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c742ca26757400288ef69caac251d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbbd8fb9af44b38b4c48be901f137a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:50:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Creating image(s)
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "/opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.259s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:01 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk 1073741824" returned: 0 in 0.054s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Successfully created port: 219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Cannot resize image /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'migration_context' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Successfully updated port: 219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-changed-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Refreshing instance network info cache due to event network-changed-219bf895-df64-440d-b1a0-7af19c96508d. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Instance network_info: |[{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Refreshing network info cache for port 219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Start _get_guest_xml network_info=[{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:50:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1999494908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1999494908',id=28,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-r28rr6so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:50:02Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=dba932d6-68a1-495f-a7bb-3a9a4bd34a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:50:03 user nova-compute[71026]:   <uuid>dba932d6-68a1-495f-a7bb-3a9a4bd34a1d</uuid>
Jul 27 16:50:03 user nova-compute[71026]:   <name>instance-0000001c</name>
Jul 27 16:50:03 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:50:03 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:50:03 user nova-compute[71026]:   <metadata>
Jul 27 16:50:03 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:50:03 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1999494908</nova:name>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:50:03</nova:creationTime>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:50:03 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:50:03 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:owner>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 16:50:03 user nova-compute[71026]:       </nova:owner>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:50:03 user nova-compute[71026]:       <nova:ports>
Jul 27 16:50:03 user nova-compute[71026]:         <nova:port uuid="219bf895-df64-440d-b1a0-7af19c96508d">
Jul 27 16:50:03 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 16:50:03 user nova-compute[71026]:         </nova:port>
Jul 27 16:50:03 user nova-compute[71026]:       </nova:ports>
Jul 27 16:50:03 user nova-compute[71026]:     </nova:instance>
Jul 27 16:50:03 user nova-compute[71026]:   </metadata>
Jul 27 16:50:03 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:50:03 user nova-compute[71026]:     <system>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="serial">dba932d6-68a1-495f-a7bb-3a9a4bd34a1d</entry>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="uuid">dba932d6-68a1-495f-a7bb-3a9a4bd34a1d</entry>
Jul 27 16:50:03 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:50:03 user nova-compute[71026]:     </system>
Jul 27 16:50:03 user nova-compute[71026]:   </sysinfo>
Jul 27 16:50:03 user nova-compute[71026]:   <os>
Jul 27 16:50:03 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:50:03 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:50:03 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:50:03 user nova-compute[71026]:   </os>
Jul 27 16:50:03 user nova-compute[71026]:   <features>
Jul 27 16:50:03 user nova-compute[71026]:     <acpi/>
Jul 27 16:50:03 user nova-compute[71026]:     <apic/>
Jul 27 16:50:03 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:50:03 user nova-compute[71026]:   </features>
Jul 27 16:50:03 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:50:03 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:50:03 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:50:03 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:50:03 user nova-compute[71026]:   </clock>
Jul 27 16:50:03 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:50:03 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:50:03 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:50:03 user nova-compute[71026]:   </cpu>
Jul 27 16:50:03 user nova-compute[71026]:   <devices>
Jul 27 16:50:03 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:50:03 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:50:03 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk"/>
Jul 27 16:50:03 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:50:03 user nova-compute[71026]:     </disk>
Jul 27 16:50:03 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:50:03 user nova-compute[71026]:       <mac address="fa:16:3e:0c:04:34"/>
Jul 27 16:50:03 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:50:03 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:50:03 user nova-compute[71026]:       <target dev="tap219bf895-df"/>
Jul 27 16:50:03 user nova-compute[71026]:     </interface>
Jul 27 16:50:03 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:50:03 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/console.log" append="off"/>
Jul 27 16:50:03 user nova-compute[71026]:     </serial>
Jul 27 16:50:03 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:50:03 user nova-compute[71026]:     <video>
Jul 27 16:50:03 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:50:03 user nova-compute[71026]:     </video>
Jul 27 16:50:03 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:50:03 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:50:03 user nova-compute[71026]:     </rng>
Jul 27 16:50:03 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:50:03 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:50:03 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:50:03 user nova-compute[71026]:     </memballoon>
Jul 27 16:50:03 user nova-compute[71026]:   </devices>
Jul 27 16:50:03 user nova-compute[71026]: </domain>
Jul 27 16:50:03 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1999494908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1999494908',id=28,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-r28rr6so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:50:02Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=dba932d6-68a1-495f-a7bb-3a9a4bd34a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG os_vif [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap219bf895-df, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap219bf895-df, col_values=(('external_ids', {'iface-id': '219bf895-df64-440d-b1a0-7af19c96508d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:04:34', 'vm-uuid': 'dba932d6-68a1-495f-a7bb-3a9a4bd34a1d'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:03 user nova-compute[71026]: INFO os_vif [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df')
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:50:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:0c:04:34, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:50:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:04 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updated VIF entry in instance network info cache for port 219bf895-df64-440d-b1a0-7af19c96508d. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:50:04 user nova-compute[71026]: DEBUG nova.network.neutron [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0d42d9e2-8376-41ca-b081-1d4120254184 req-f52616aa-b8ac-44a5-8eb1-9bf95f9e3db6 service nova] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] No waiting events found dispatching network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:05 user nova-compute[71026]: WARNING nova.compute.manager [req-f6c5e36c-699b-4ddf-aeb3-c9cc7201f5f0 req-7acc000b-600a-408c-a06a-6394bfa627fc service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received unexpected event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d for instance with vm_state building and task_state spawning.
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476607.2900078, dba932d6-68a1-495f-a7bb-3a9a4bd34a1d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] VM Resumed (Lifecycle Event)
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Instance spawned successfully.
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476607.291371, dba932d6-68a1-495f-a7bb-3a9a4bd34a1d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] VM Started (Lifecycle Event)
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] No waiting events found dispatching network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:07 user nova-compute[71026]: WARNING nova.compute.manager [req-4c6ae382-e4db-4159-a4ff-2d28fb5bcb20 req-1cae6f9d-ba50-4a73-a78d-ddfa509b4285 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received unexpected event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d for instance with vm_state building and task_state spawning.
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Took 5.70 seconds to spawn the instance on the hypervisor.
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.compute.manager [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Took 6.41 seconds to build instance.
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1589df95-dc86-46ac-bd82-b6a71d13a0cf tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.503s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Starting finish_migration {{(pid=71026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:50:07 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Creating image(s)
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start _get_guest_xml network_info=[{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8e325b0f-4f45-44aa-9394-123681658d36', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0aa475ea-5c70-4ff6-9141-9b088dc52ebf', 'attached_at': '2023-07-27T16:50:07.000000', 'detached_at': '', 'volume_id': 'd44e8cd6-67bc-4314-80de-998240af7770', 'serial': 'd44e8cd6-67bc-4314-80de-998240af7770'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:50:07 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:07 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.objects.instance [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:50:07 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:50:07 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:50:07 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93468d-579c-462b-a7bc-1f4c6829386f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:50:07 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b9ad9c-701b-46b9-931e-d5658523407c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770] added
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fc0c60-2c4e-4d12-86d1-b7553c581a2f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e0c6fc-c980-4beb-aba0-198902bd4387]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXmwyHOU {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KXmwyHOU" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33a0841-8adc-4d7d-8cc0-3114e545d93a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KXmwyHOU'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc02fba-4531-485b-a1a7-95f87821dbf5]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd7386-d801-4b9b-8222-6fd17d71ac8f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16961f54-f7ba-4890-a275-eae2f0aa671c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]
Jul 27 16:50:07 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05268c22-2d72-42f7-ace1-72f4390793b6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e57258f-7ada-44ad-ab7d-5685282584db]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:07 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:07 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[18204def-b7c1-4d68-a6bc-892dad7117e5]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:07 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476593.391241, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:08 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Stopped (Lifecycle Event)
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e203aeaf-1703-492a-a61b-6c60b39ee8dc None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e203aeaf-1703-492a-a61b-6c60b39ee8dc None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:08 user nova-compute[71026]: INFO nova.compute.manager [None req-e203aeaf-1703-492a-a61b-6c60b39ee8dc None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26234373138363237', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234373138363237', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:50:08 user nova-compute[71026]:   <uuid>0aa475ea-5c70-4ff6-9141-9b088dc52ebf</uuid>
Jul 27 16:50:08 user nova-compute[71026]:   <name>instance-0000001a</name>
Jul 27 16:50:08 user nova-compute[71026]:   <memory>2097152</memory>
Jul 27 16:50:08 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:50:08 user nova-compute[71026]:   <metadata>
Jul 27 16:50:08 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:50:08 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:50:08 user nova-compute[71026]:       <nova:name>tempest-ServerActionsTestOtherA-server-1255413258</nova:name>
Jul 27 16:50:08 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:50:07</nova:creationTime>
Jul 27 16:50:08 user nova-compute[71026]:       <nova:flavor name="m1.small">
Jul 27 16:50:08 user nova-compute[71026]:         <nova:memory>2048</nova:memory>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:disk>20</nova:disk>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:50:08 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:50:08 user nova-compute[71026]:       <nova:owner>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:user uuid="e106be16f498443091e8ae9f95311beb">tempest-ServerActionsTestOtherA-1832986311-project-member</nova:user>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:project uuid="40b15450553d464cbeac2d3d910e8043">tempest-ServerActionsTestOtherA-1832986311</nova:project>
Jul 27 16:50:08 user nova-compute[71026]:       </nova:owner>
Jul 27 16:50:08 user nova-compute[71026]:       <nova:ports>
Jul 27 16:50:08 user nova-compute[71026]:         <nova:port uuid="16e29a1c-b62b-48b5-88d5-0666f4d72b5f">
Jul 27 16:50:08 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:50:08 user nova-compute[71026]:         </nova:port>
Jul 27 16:50:08 user nova-compute[71026]:       </nova:ports>
Jul 27 16:50:08 user nova-compute[71026]:     </nova:instance>
Jul 27 16:50:08 user nova-compute[71026]:   </metadata>
Jul 27 16:50:08 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:50:08 user nova-compute[71026]:     <system>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="serial">0aa475ea-5c70-4ff6-9141-9b088dc52ebf</entry>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="uuid">0aa475ea-5c70-4ff6-9141-9b088dc52ebf</entry>
Jul 27 16:50:08 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:50:08 user nova-compute[71026]:     </system>
Jul 27 16:50:08 user nova-compute[71026]:   </sysinfo>
Jul 27 16:50:08 user nova-compute[71026]:   <os>
Jul 27 16:50:08 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:50:08 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:50:08 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:50:08 user nova-compute[71026]:   </os>
Jul 27 16:50:08 user nova-compute[71026]:   <features>
Jul 27 16:50:08 user nova-compute[71026]:     <acpi/>
Jul 27 16:50:08 user nova-compute[71026]:     <apic/>
Jul 27 16:50:08 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:50:08 user nova-compute[71026]:   </features>
Jul 27 16:50:08 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:50:08 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:50:08 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:50:08 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:50:08 user nova-compute[71026]:   </clock>
Jul 27 16:50:08 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:50:08 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:50:08 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:50:08 user nova-compute[71026]:   </cpu>
Jul 27 16:50:08 user nova-compute[71026]:   <devices>
Jul 27 16:50:08 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:50:08 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:50:08 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:50:08 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:50:08 user nova-compute[71026]:       <serial>d44e8cd6-67bc-4314-80de-998240af7770</serial>
Jul 27 16:50:08 user nova-compute[71026]:     </disk>
Jul 27 16:50:08 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:50:08 user nova-compute[71026]:       <mac address="fa:16:3e:4f:f4:03"/>
Jul 27 16:50:08 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:50:08 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:50:08 user nova-compute[71026]:       <target dev="tap16e29a1c-b6"/>
Jul 27 16:50:08 user nova-compute[71026]:     </interface>
Jul 27 16:50:08 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:50:08 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf/console.log" append="off"/>
Jul 27 16:50:08 user nova-compute[71026]:     </serial>
Jul 27 16:50:08 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:50:08 user nova-compute[71026]:     <video>
Jul 27 16:50:08 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:50:08 user nova-compute[71026]:     </video>
Jul 27 16:50:08 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:50:08 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:50:08 user nova-compute[71026]:     </rng>
Jul 27 16:50:08 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:50:08 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:50:08 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:50:08 user nova-compute[71026]:     </memballoon>
Jul 27 16:50:08 user nova-compute[71026]:   </devices>
Jul 27 16:50:08 user nova-compute[71026]: </domain>
Jul 27 16:50:08 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-55173722-network", "vif_mac": "fa:16:3e:4f:f4:03"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG os_vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16e29a1c-b6, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16e29a1c-b6, col_values=(('external_ids', {'iface-id': '16e29a1c-b62b-48b5-88d5-0666f4d72b5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:f4:03', 'vm-uuid': '0aa475ea-5c70-4ff6-9141-9b088dc52ebf'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:50:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:08 user nova-compute[71026]: INFO os_vif [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6')
Jul 27 16:50:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:50:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] No VIF found with MAC fa:16:3e:4f:f4:03, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:50:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG nova.compute.manager [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:10 user nova-compute[71026]: DEBUG nova.compute.manager [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:10 user nova-compute[71026]: WARNING nova.compute.manager [req-a604c74d-e4a0-424b-9f78-90ddc7eb97a3 req-a8759df0-d5a3-4d2e-b405-9fef12ce5617 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state active and task_state resize_finish.
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476612.5475814, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:12 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Resumed (Lifecycle Event)
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:50:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance running successfully.
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Failed to set time: agent not configured {{(pid=71026) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-12c61df6-a958-4da6-81b6-00f17724c9e9 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] finish_migration finished successfully. {{(pid=71026) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:12 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476612.548379, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:12 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Started (Lifecycle Event)
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:12 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:12 user nova-compute[71026]: WARNING nova.compute.manager [req-89f0e6ee-f269-491c-9233-86353b8aab71 req-45c7a5fd-4f84-49a3-a9a5-3fe95ad1cccc service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state active and task_state resize_finish.
Jul 27 16:50:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:15 user nova-compute[71026]: INFO nova.compute.manager [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Detaching volume 350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:50:15 user nova-compute[71026]: INFO nova.virt.block_device [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Attempting to driver detach volume 350b6fba-6003-491a-acee-5c9399e8d086 from mountpoint /dev/vdb
Jul 27 16:50:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Attempting to detach device vdb from instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:50:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:50:15 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:50:15 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:50:15 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:50:15 user nova-compute[71026]:   <serial>350b6fba-6003-491a-acee-5c9399e8d086</serial>
Jul 27 16:50:15 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 16:50:15 user nova-compute[71026]: </disk>
Jul 27 16:50:15 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:50:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdb from instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 from the persistent domain config.
Jul 27 16:50:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:50:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:50:15 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:50:15 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 16:50:15 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:50:15 user nova-compute[71026]:   <serial>350b6fba-6003-491a-acee-5c9399e8d086</serial>
Jul 27 16:50:15 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 16:50:15 user nova-compute[71026]: </disk>
Jul 27 16:50:15 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690476616.4118712, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:50:16 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdb from instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 from the live domain config.
Jul 27 16:50:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vQhgOyGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:50:16 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[724dcaf1-ac79-45b2-be27-f8dc46fcb8c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:50:16 user nova-compute[71026]: No targets found.
Jul 27 16:50:16 user nova-compute[71026]: iSNS:
Jul 27 16:50:16 user nova-compute[71026]: No targets found.
Jul 27 16:50:16 user nova-compute[71026]: STATIC:
Jul 27 16:50:16 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086
Jul 27 16:50:16 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:16 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:16 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c
Jul 27 16:50:16 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:16 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:16 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:50:16 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:16 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:16 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:50:16 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:16 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:16 user nova-compute[71026]: FIRMWARE:
Jul 27 16:50:16 user nova-compute[71026]: No targets found.
Jul 27 16:50:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:50:16 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:50:16 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880d989-bfe6-4fb2-b554-78fd048cbf80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3d020-47de-475a-bf78-0cc33ef2077f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088542320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb86991-6729-48f1-9cf3-08fd47d9b242]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ba2d9-c3bf-4b14-a029-6bdf54421c82]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e29210-b35e-4717-a807-92e1ffcd8e30]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4063d59a-fe6c-4c88-9cbc-bc093eb3dc6b]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bfbe34-b311-4062-a0de-fce036883ba1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec4db7-2976-41ea-a07e-4d8a0ca9af27]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260]
Jul 27 16:50:16 user nova-compute[71026]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086, portal: 172.16.0.220,3260] successful.
Jul 27 16:50:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:350b6fba-6003-491a-acee-5c9399e8d086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b382f051-b3a5-49c7-a913-4b4df1d9f33f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== disconnect_volume: return (466ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:50:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG nova.compute.manager [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing instance network info cache due to event network-changed-42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] Acquiring lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] Acquired lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG nova.network.neutron [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Refreshing network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:17 user nova-compute[71026]: INFO nova.compute.manager [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Terminating instance
Jul 27 16:50:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cb1e995-25b6-4527-a1b4-a53d128adcaf tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.088s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-a8ca3777-64a6-4275-ae0d-7fe46aebc0dc req-d29c674b-bcb6-411c-9604-9204082ca45a service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-unplugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.network.neutron [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updated VIF entry in instance network info cache for port 42e5797d-04b4-454d-98de-385c51ca70f2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.network.neutron [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [{"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76a881a9-04d9-4b6a-aded-1e91abdbedea req-197fc2c2-9fb2-4845-89ab-5974b5b2c330 service nova] Releasing lock "refresh_cache-56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71026) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Instance destroyed successfully.
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lazy-loading 'resources' on Instance uuid 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-893891946',display_name='tempest-TestShelveInstance-server-893891946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-893891946',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTdxKL7iEwgys02p15YUAFpKg4miLcztjkjASObzm9oJItTISnaWlEnZp4YSKUkoYfuloTYK5R+0f8ddEbTV7HusTnRKkgwdeEJMxrnts6YZFBuLVnOK/xby7KGXDk6Sg==',key_name='tempest-TestShelveInstance-1110890233',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:48:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3d01c4091154135a4fab0a817e406c3',ramdisk_id='',reservation_id='r-ua4r0y6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-697106287',owner_user_name='tempest-TestShelveInstance-697106287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:48:42Z,user_data=None,user_id='65274ecb1cb84995a5ab9d43e315ac2a',uuid=56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converting VIF {"id": "42e5797d-04b4-454d-98de-385c51ca70f2", "address": "fa:16:3e:74:c4:81", "network": {"id": "5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1847543873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d01c4091154135a4fab0a817e406c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42e5797d-04", "ovs_interfaceid": "42e5797d-04b4-454d-98de-385c51ca70f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_vif [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42e5797d-04, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:18 user nova-compute[71026]: INFO os_vif [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c4:81,bridge_name='br-int',has_traffic_filtering=True,id=42e5797d-04b4-454d-98de-385c51ca70f2,network=Network(5ffa1079-c99f-4ff2-a0a6-8c8e5466dbf6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42e5797d-04')
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDJbanSk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:50:18 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a3fa66-be75-49d4-8808-d30c9174ab3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:50:18 user nova-compute[71026]: No targets found.
Jul 27 16:50:18 user nova-compute[71026]: iSNS:
Jul 27 16:50:18 user nova-compute[71026]: No targets found.
Jul 27 16:50:18 user nova-compute[71026]: STATIC:
Jul 27 16:50:18 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c
Jul 27 16:50:18 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:18 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:18 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:50:18 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:18 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:18 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312
Jul 27 16:50:18 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:50:18 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:50:18 user nova-compute[71026]: FIRMWARE:
Jul 27 16:50:18 user nova-compute[71026]: No targets found.
Jul 27 16:50:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:50:18 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:50:18 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b37caff-1064-4787-a743-8319c19e5cc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d625ca-ce5f-44d0-9ab8-46f3967b45f3]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:18 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:18 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 (non-flash)
Jul 27 16:50:18 user nova-compute[71026]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:50:18 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:50:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308868ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b2a86-b78f-4791-aed4-332f8f4b6889]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8081700-8319-4537-89f8-b3e1d60a93f8]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87d42e0-0174-4862-bd19-15c8fb6a915e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.103s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c8ff4-4054-4b7f-96b9-1eeab6e5d0db]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ff988af', '/dev/disk/by-id/scsi-1SCST_BIO7ff988af-19ff9df72db4fe88', '/dev/disk/by-id/scsi-23139666639646637') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[880e208f-87ca-4628-bb45-d5c27b71eb1e]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3953956e-a90d-400e-9e04-46ea33db66b0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b575df-7221-4ebd-b8f6-d3b0e819abe8]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260]
Jul 27 16:50:18 user nova-compute[71026]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312, portal: 172.16.0.220,3260] successful.
Jul 27 16:50:18 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd816e9b-98d2-4ab7-b85d-8d5a850ce39c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] <== disconnect_volume: return (466ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:50:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:50:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deleting instance files /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1_del
Jul 27 16:50:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deletion of /opt/stack/data/nova/instances/56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1_del complete
Jul 27 16:50:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance destroyed successfully.
Jul 27 16:50:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:19 user nova-compute[71026]: INFO nova.compute.manager [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Took 1.61 seconds to destroy the instance on the hypervisor.
Jul 27 16:50:19 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:50:19 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:50:19 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:50:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a294bd95-b11e-4e0c-a9fe-e2c59944f230 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.892s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:19 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:19 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Took 0.58 seconds to deallocate network for instance.
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Acquiring lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] No waiting events found dispatching network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:20 user nova-compute[71026]: WARNING nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received unexpected event network-vif-plugged-42e5797d-04b4-454d-98de-385c51ca70f2 for instance with vm_state active and task_state deleting.
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:20 user nova-compute[71026]: WARNING nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state None.
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:20 user nova-compute[71026]: WARNING nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state None.
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-b7d02796-68c2-4644-8dc6-400f3abd14a4 req-98592768-3765-49f0-ae11-de65e91bdf80 service nova] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Received event network-vif-deleted-42e5797d-04b4-454d-98de-385c51ca70f2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:20 user nova-compute[71026]: INFO nova.compute.manager [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Took 1.03 seconds to detach 1 volumes for instance.
Jul 27 16:50:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Deleting volume: 37d4a616-2db3-4b7e-b2c1-0f8b6c9e2312 {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:50:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:50:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:21 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Deleted allocations for instance 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1
Jul 27 16:50:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb0703a8-6f38-4813-9327-f290843aa3a9 tempest-TestShelveInstance-697106287 tempest-TestShelveInstance-697106287-project-member] Lock "56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:50:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:50:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:29 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:29 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.700252532958984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Applying migration context for instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf as it has an incoming, in-progress migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49. Migration status is finished {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 16:50:29 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating resource usage from migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:33 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476618.4167347, 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:33 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] VM Stopped (Lifecycle Event)
Jul 27 16:50:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-23884491-703a-4f24-9727-e6f7285a9769 None None] [instance: 56ad66f6-ce76-47ab-8fa0-4978bb5cf8a1] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:34 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476619.0219343, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:34 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Stopped (Lifecycle Event)
Jul 27 16:50:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b7a8fce9-fa83-4f37-9679-d57e19b0be31 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b7a8fce9-fa83-4f37-9679-d57e19b0be31 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:50:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 16:50:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:39 user nova-compute[71026]: INFO nova.compute.manager [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Terminating instance
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-9a1400c2-7631-42fa-a3b2-4038caaeb5a1 req-7a7a462d-b937-4a9e-89f0-ce5a426ca3b2 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-unplugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Instance destroyed successfully.
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.objects.instance [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-367530359',display_name='tempest-ServerRescueNegativeTestJSON-server-367530359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-367530359',id=5,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-nug1sdfn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:36:31Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=d6e2b6dc-8408-4f7d-8286-68fd01ef25c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "address": "fa:16:3e:21:2e:1c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape03a7098-b9", "ovs_interfaceid": "e03a7098-b905-4b6b-8f2f-9eb80afc928d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG os_vif [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape03a7098-b9, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:50:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:40 user nova-compute[71026]: INFO os_vif [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:2e:1c,bridge_name='br-int',has_traffic_filtering=True,id=e03a7098-b905-4b6b-8f2f-9eb80afc928d,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape03a7098-b9')
Jul 27 16:50:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Deleting instance files /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6_del
Jul 27 16:50:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Deletion of /opt/stack/data/nova/instances/d6e2b6dc-8408-4f7d-8286-68fd01ef25c6_del complete
Jul 27 16:50:40 user nova-compute[71026]: INFO nova.compute.manager [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 16:50:40 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:50:40 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:50:40 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:50:40 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:40 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Took 0.63 seconds to deallocate network for instance.
Jul 27 16:50:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:41 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Deleted allocations for instance d6e2b6dc-8408-4f7d-8286-68fd01ef25c6
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-28aba132-b2d3-4008-8e6a-2176e06fde54 tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.052s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] Acquiring lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] Lock "d6e2b6dc-8408-4f7d-8286-68fd01ef25c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:50:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] No waiting events found dispatching network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:50:41 user nova-compute[71026]: WARNING nova.compute.manager [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received unexpected event network-vif-plugged-e03a7098-b905-4b6b-8f2f-9eb80afc928d for instance with vm_state deleted and task_state None.
Jul 27 16:50:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-3dd049ca-07e3-4cb2-9f0e-bfc75052df8b req-6a4556b3-1ad3-47a8-a3c6-50d073e62951 service nova] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Received event network-vif-deleted-e03a7098-b905-4b6b-8f2f-9eb80afc928d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:50:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 16:50:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 16:50:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-changed-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Refreshing instance network info cache due to event network-changed-721c9544-64e0-447e-b6e7-d0d63e258060. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] Acquiring lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] Acquired lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Refreshing network info cache for port 721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updated VIF entry in instance network info cache for port 721c9544-64e0-447e-b6e7-d0d63e258060. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating instance_info_cache with network_info: [{"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-300ae0aa-f173-4540-8737-390fb53b0a87 req-e72f87b3-2c76-4a3b-8d2e-86da3dc6d9b5 service nova] Releasing lock "refresh_cache-bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476639.9439628, d6e2b6dc-8408-4f7d-8286-68fd01ef25c6 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:50:54 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] VM Stopped (Lifecycle Event)
Jul 27 16:50:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7ccbfe76-c8ec-4962-91c6-9129f080ef58 None None] [instance: d6e2b6dc-8408-4f7d-8286-68fd01ef25c6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:50:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:50:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:51:02 user nova-compute[71026]: INFO nova.compute.claims [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Claim successful on node user
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:51:02 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:51:02 user nova-compute[71026]: INFO nova.virt.block_device [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Booting with volume snapshot 760ee486-4fff-4da5-8bce-7b5bc8a5a789 at /dev/vda
Jul 27 16:51:02 user nova-compute[71026]: DEBUG nova.policy [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:51:03 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Successfully created port: b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Successfully updated port: b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-changed-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Refreshing instance network info cache due to event network-changed-b297c225-06ba-41c2-a098-b4c3b66e27b3. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] Acquiring lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.network.neutron [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updating instance_info_cache with network_info: [{"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Instance network_info: |[{"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] Acquired lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG nova.network.neutron [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Refreshing network info cache for port b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:51:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:05 user nova-compute[71026]: DEBUG nova.network.neutron [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updated VIF entry in instance network info cache for port b297c225-06ba-41c2-a098-b4c3b66e27b3. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:51:05 user nova-compute[71026]: DEBUG nova.network.neutron [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updating instance_info_cache with network_info: [{"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:51:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-770223e6-7140-4d1f-a4b3-c6c48beca6dc req-c3b24db8-e359-43b7-b840-92b185a2a5d4 service nova] Releasing lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.utils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae752f46-06ee-47a2-9963-53ef830d48e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3bcd9-8774-41e3-a17b-b81abf2ed79d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d3922f-3951-4bcf-99b3-82b2968d6278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15dd32e-7470-4aba-898b-1362c02b7dde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:51:08 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:51:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3962a5-abbb-496b-bff6-873b23fc7e88]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG os_brick.utils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:51:08 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updating existing volume attachment record: b94398ff-4ecf-4d24-8eb2-556882b2a0b5 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:51:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:51:15 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Creating image(s)
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Ensure instance console log exists: /opt/stack/data/nova/instances/113be118-e8ae-4ee2-b2d8-13636b535813/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Start _get_guest_xml network_info=[{"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T16:50:55Z,direct_url=<?>,disk_format='qcow2',id=00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1547563691',owner='3985a0dd491c44958ba564c9c8ef6e4f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T16:50:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b94398ff-4ecf-4d24-8eb2-556882b2a0b5', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIhcEQnH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '113be118-e8ae-4ee2-b2d8-13636b535813', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8712f7d-3684-431d-988e-5a1ae3d24b8d', 'serial': 'f8712f7d-3684-431d-988e-5a1ae3d24b8d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:51:15 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:51:15 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-27T16:50:55Z,direct_url=<?>,disk_format='qcow2',id=00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1547563691',owner='3985a0dd491c44958ba564c9c8ef6e4f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-27T16:50:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIhcEQnH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:51:15 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:51:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:51:15 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:51:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:51:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:51:15 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:51:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc5d4f-38fc-4082-bda4-4f3db4c8d02d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:51:16 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae444c8c-b6d8-4e0f-868e-293ef9017d5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d] added
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c242626b-6efb-43dd-a5a8-6d804b4042e2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b25b9-97b5-41e7-8d68-eefb47923e63]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIhcEQnH {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIhcEQnH" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eda2bc-d068-48a7-8506-15b2429c4421]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIhcEQnH'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2604801-aa91-46ec-90a3-b522fedf42cd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17be3e9-3c43-4d1d-a6a7-297de1913858]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[47490e73-a6ec-4615-b56b-98755a971d2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260]
Jul 27 16:51:16 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260] successful.
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8819929-d954-4e54-8ba5-5909c664fb19]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[82640b02-2c0e-4d13-a378-8409c366a7dd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:51:16 user nova-compute[71026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)
Jul 27 16:51:16 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d360086-a784-4388-81ac-b1c4d4145b90]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:51:16 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIhcEQnH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26463363165313731', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463363165313731', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2144855537',id=29,image_ref='00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhSJA5b+2VOb8lSfeHNkg7TUih+4A2B25CQvS564Es5zoYNktJpCCwZIEvga8AJ79GRxarhtIEMIeO/yT+G3DAPH11R7LqyqDpWXW1nF66uvjh+lVoO6Ad+spArJ7HvgQ==',key_name='tempest-keypair-230078257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-4dzw0fon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2066891657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=113be118-e8ae-4ee2-b2d8-13636b535813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.objects.instance [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid 113be118-e8ae-4ee2-b2d8-13636b535813 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:51:17 user nova-compute[71026]:   <uuid>113be118-e8ae-4ee2-b2d8-13636b535813</uuid>
Jul 27 16:51:17 user nova-compute[71026]:   <name>instance-0000001d</name>
Jul 27 16:51:17 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:51:17 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:51:17 user nova-compute[71026]:   <metadata>
Jul 27 16:51:17 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:51:17 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2144855537</nova:name>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:51:15</nova:creationTime>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:51:17 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:51:17 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:owner>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:51:17 user nova-compute[71026]:       </nova:owner>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:root type="image" uuid="00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed"/>
Jul 27 16:51:17 user nova-compute[71026]:       <nova:ports>
Jul 27 16:51:17 user nova-compute[71026]:         <nova:port uuid="b297c225-06ba-41c2-a098-b4c3b66e27b3">
Jul 27 16:51:17 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 16:51:17 user nova-compute[71026]:         </nova:port>
Jul 27 16:51:17 user nova-compute[71026]:       </nova:ports>
Jul 27 16:51:17 user nova-compute[71026]:     </nova:instance>
Jul 27 16:51:17 user nova-compute[71026]:   </metadata>
Jul 27 16:51:17 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:51:17 user nova-compute[71026]:     <system>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="serial">113be118-e8ae-4ee2-b2d8-13636b535813</entry>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="uuid">113be118-e8ae-4ee2-b2d8-13636b535813</entry>
Jul 27 16:51:17 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:51:17 user nova-compute[71026]:     </system>
Jul 27 16:51:17 user nova-compute[71026]:   </sysinfo>
Jul 27 16:51:17 user nova-compute[71026]:   <os>
Jul 27 16:51:17 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:51:17 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:51:17 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:51:17 user nova-compute[71026]:   </os>
Jul 27 16:51:17 user nova-compute[71026]:   <features>
Jul 27 16:51:17 user nova-compute[71026]:     <acpi/>
Jul 27 16:51:17 user nova-compute[71026]:     <apic/>
Jul 27 16:51:17 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:51:17 user nova-compute[71026]:   </features>
Jul 27 16:51:17 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:51:17 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:51:17 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:51:17 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:51:17 user nova-compute[71026]:   </clock>
Jul 27 16:51:17 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:51:17 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:51:17 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:51:17 user nova-compute[71026]:   </cpu>
Jul 27 16:51:17 user nova-compute[71026]:   <devices>
Jul 27 16:51:17 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:51:17 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:51:17 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:51:17 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:51:17 user nova-compute[71026]:       <serial>f8712f7d-3684-431d-988e-5a1ae3d24b8d</serial>
Jul 27 16:51:17 user nova-compute[71026]:     </disk>
Jul 27 16:51:17 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:51:17 user nova-compute[71026]:       <mac address="fa:16:3e:c8:43:ef"/>
Jul 27 16:51:17 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:51:17 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:51:17 user nova-compute[71026]:       <target dev="tapb297c225-06"/>
Jul 27 16:51:17 user nova-compute[71026]:     </interface>
Jul 27 16:51:17 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:51:17 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/113be118-e8ae-4ee2-b2d8-13636b535813/console.log" append="off"/>
Jul 27 16:51:17 user nova-compute[71026]:     </serial>
Jul 27 16:51:17 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:51:17 user nova-compute[71026]:     <video>
Jul 27 16:51:17 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:51:17 user nova-compute[71026]:     </video>
Jul 27 16:51:17 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:51:17 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:51:17 user nova-compute[71026]:     </rng>
Jul 27 16:51:17 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:51:17 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:51:17 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:51:17 user nova-compute[71026]:     </memballoon>
Jul 27 16:51:17 user nova-compute[71026]:   </devices>
Jul 27 16:51:17 user nova-compute[71026]: </domain>
Jul 27 16:51:17 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2144855537',id=29,image_ref='00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhSJA5b+2VOb8lSfeHNkg7TUih+4A2B25CQvS564Es5zoYNktJpCCwZIEvga8AJ79GRxarhtIEMIeO/yT+G3DAPH11R7LqyqDpWXW1nF66uvjh+lVoO6Ad+spArJ7HvgQ==',key_name='tempest-keypair-230078257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-4dzw0fon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2066891657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:51:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=113be118-e8ae-4ee2-b2d8-13636b535813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG os_vif [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb297c225-06, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb297c225-06, col_values=(('external_ids', {'iface-id': 'b297c225-06ba-41c2-a098-b4c3b66e27b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:43:ef', 'vm-uuid': '113be118-e8ae-4ee2-b2d8-13636b535813'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:17 user nova-compute[71026]: INFO os_vif [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06')
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:51:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:c8:43:ef, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:51:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] No waiting events found dispatching network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:51:19 user nova-compute[71026]: WARNING nova.compute.manager [req-64a9e1d2-9da4-49ad-9bad-2fb18daa8e2e req-12e3b4bc-85bd-4e12-93b9-c57c559982ff service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received unexpected event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 for instance with vm_state building and task_state spawning.
Jul 27 16:51:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476680.8998692, 113be118-e8ae-4ee2-b2d8-13636b535813 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:51:20 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] VM Resumed (Lifecycle Event)
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:51:20 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Instance spawned successfully.
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:51:20 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476680.9032238, 113be118-e8ae-4ee2-b2d8-13636b535813 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:51:20 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] VM Started (Lifecycle Event)
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:51:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:51:21 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:51:21 user nova-compute[71026]: INFO nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Took 5.11 seconds to spawn the instance on the hypervisor.
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] No waiting events found dispatching network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:51:21 user nova-compute[71026]: WARNING nova.compute.manager [req-2c509da2-810c-4815-9ad7-7ed0c92ff2a5 req-f5228f2d-5153-4dc1-a8d3-7acb21c87c25 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received unexpected event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 for instance with vm_state building and task_state spawning.
Jul 27 16:51:21 user nova-compute[71026]: INFO nova.compute.manager [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Took 18.83 seconds to build instance.
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cd05f8f7-e0cd-4373-8907-4563a50975e7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.978s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 113be118-e8ae-4ee2-b2d8-13636b535813 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:51:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:51:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7975MB free_disk=25.71445083618164GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Applying migration context for instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf as it has an incoming, in-progress migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49. Migration status is finished {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:996}}
Jul 27 16:51:28 user nova-compute[71026]: INFO nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating resource usage from migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b991c2a5-894c-49e7-896c-69eb95eb84bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1683}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 113be118-e8ae-4ee2-b2d8-13636b535813 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:51:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:30 user nova-compute[71026]: INFO nova.compute.manager [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Terminating instance
Jul 27 16:51:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:51:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-3edfb5c9-5676-4da7-a05c-ec4400da2a88 req-ed5f7529-09e5-4f88-baec-d25216f76c4a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-unplugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Instance destroyed successfully.
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lazy-loading 'resources' on Instance uuid b991c2a5-894c-49e7-896c-69eb95eb84bd {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:34:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1323839499',display_name='tempest-ServerRescueNegativeTestJSON-server-1323839499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1323839499',id=3,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6408faede31045a6a3a34304629caa4f',ramdisk_id='',reservation_id='r-dr4vxw0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-882048111',owner_user_name='tempest-ServerRescueNegativeTestJSON-882048111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:41:07Z,user_data=None,user_id='421dd87102724509a506e368de55faaf',uuid=b991c2a5-894c-49e7-896c-69eb95eb84bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converting VIF {"id": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "address": "fa:16:3e:db:d9:0c", "network": {"id": "daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-401616925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6408faede31045a6a3a34304629caa4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd401c2c4-92", "ovs_interfaceid": "d401c2c4-92ad-4060-a4bd-157e7ca89ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG os_vif [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd401c2c4-92, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:31 user nova-compute[71026]: INFO os_vif [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:d9:0c,bridge_name='br-int',has_traffic_filtering=True,id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2,network=Network(daa5ffcb-4f95-4ef6-b8a3-acaa7b5e9ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd401c2c4-92')
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Deleting instance files /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd_del
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Deletion of /opt/stack/data/nova/instances/b991c2a5-894c-49e7-896c-69eb95eb84bd_del complete
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.compute.manager [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Took 0.73 seconds to destroy the instance on the hypervisor.
Jul 27 16:51:31 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Took 0.48 seconds to deallocate network for instance.
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-34c8665a-0096-4a14-bf97-230403e4e160 req-a18f11c7-09c0-46ad-9a52-6bdbd7eeab32 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-deleted-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:31 user nova-compute[71026]: INFO nova.compute.manager [req-34c8665a-0096-4a14-bf97-230403e4e160 req-a18f11c7-09c0-46ad-9a52-6bdbd7eeab32 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Neutron deleted interface d401c2c4-92ad-4060-a4bd-157e7ca89ef2; detaching it from the instance and deleting it from the info cache
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.network.neutron [req-34c8665a-0096-4a14-bf97-230403e4e160 req-a18f11c7-09c0-46ad-9a52-6bdbd7eeab32 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-34c8665a-0096-4a14-bf97-230403e4e160 req-a18f11c7-09c0-46ad-9a52-6bdbd7eeab32 service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Detach interface failed, port_id=d401c2c4-92ad-4060-a4bd-157e7ca89ef2, reason: Instance b991c2a5-894c-49e7-896c-69eb95eb84bd could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:32 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Deleted allocations for instance b991c2a5-894c-49e7-896c-69eb95eb84bd
Jul 27 16:51:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-43e07d99-7861-4feb-bc8a-237148ab596f tempest-ServerRescueNegativeTestJSON-882048111 tempest-ServerRescueNegativeTestJSON-882048111-project-member] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.703s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] Acquiring lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] Lock "b991c2a5-894c-49e7-896c-69eb95eb84bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] No waiting events found dispatching network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:51:32 user nova-compute[71026]: WARNING nova.compute.manager [req-5ac208a7-7e9e-4119-9f48-ea8dea521005 req-d623e723-4d8d-4cba-a758-6e8df228657a service nova] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Received unexpected event network-vif-plugged-d401c2c4-92ad-4060-a4bd-157e7ca89ef2 for instance with vm_state deleted and task_state None.
Jul 27 16:51:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Going to confirm migration 2 {{(pid=71026) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'info_cache' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'migration_context' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:51:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:51:42 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:51:42 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:51:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.348s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:42 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Deleted allocation for migration f14a71d9-62d9-40c2-b4cb-3ef3fe2d7a49
Jul 27 16:51:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0ee2508b-4a82-4374-89e5-2b67aa25a8c6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.523s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:51:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:46 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476691.1456008, b991c2a5-894c-49e7-896c-69eb95eb84bd => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:51:46 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] VM Stopped (Lifecycle Event)
Jul 27 16:51:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-eb31b572-eda7-45c9-ad63-387ca0195a46 None None] [instance: b991c2a5-894c-49e7-896c-69eb95eb84bd] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:51:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:51:52 user nova-compute[71026]: INFO nova.compute.manager [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] instance snapshotting
Jul 27 16:51:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Beginning live snapshot process
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844.delta 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844.delta 1073741824" returned: 0 in 0.058s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 16:51:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:51:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] COPY block job progress, current cursor: 26607616 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:51:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 16:51:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 16:51:54 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:51:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844.delta /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:51:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844.delta /opt/stack/data/nova/instances/snapshots/tmpgqfovddm/752d66c7a87247ee946495097c705844" returned: 0 in 0.718s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:51:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Snapshot extracted, beginning image upload
Jul 27 16:51:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:51:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Snapshot image upload complete
Jul 27 16:51:57 user nova-compute[71026]: INFO nova.compute.manager [None req-c211596c-8845-46de-8195-57c456a1cd5c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Took 5.43 seconds to snapshot the instance on the hypervisor.
Jul 27 16:52:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.neutron [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'info_cache' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.neutron [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:52:09 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance destroyed successfully.
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'resources' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG os_vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d5e45c-b2, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:52:09 user nova-compute[71026]: INFO os_vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start _get_guest_xml network_info=[{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'numa_topology' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:52:09 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'pci_devices' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:52:09 user nova-compute[71026]:   <uuid>95dcc9cc-42b0-413a-acd8-921a1197c8d9</uuid>
Jul 27 16:52:09 user nova-compute[71026]:   <name>instance-00000016</name>
Jul 27 16:52:09 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:52:09 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:52:09 user nova-compute[71026]:   <metadata>
Jul 27 16:52:09 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:52:09 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeTestJSON-server-904067667</nova:name>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:52:09</nova:creationTime>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:52:09 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:52:09 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:owner>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:user uuid="c543c6c138ad482ca985d5a756f78334">tempest-AttachVolumeTestJSON-2013998243-project-member</nova:user>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:project uuid="c4a20fd76c514ce488f9467e5ec36012">tempest-AttachVolumeTestJSON-2013998243</nova:project>
Jul 27 16:52:09 user nova-compute[71026]:       </nova:owner>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:52:09 user nova-compute[71026]:       <nova:ports>
Jul 27 16:52:09 user nova-compute[71026]:         <nova:port uuid="d4d5e45c-b26e-492f-9a92-f0bc0c120325">
Jul 27 16:52:09 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 16:52:09 user nova-compute[71026]:         </nova:port>
Jul 27 16:52:09 user nova-compute[71026]:       </nova:ports>
Jul 27 16:52:09 user nova-compute[71026]:     </nova:instance>
Jul 27 16:52:09 user nova-compute[71026]:   </metadata>
Jul 27 16:52:09 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:52:09 user nova-compute[71026]:     <system>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="serial">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="uuid">95dcc9cc-42b0-413a-acd8-921a1197c8d9</entry>
Jul 27 16:52:09 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:52:09 user nova-compute[71026]:     </system>
Jul 27 16:52:09 user nova-compute[71026]:   </sysinfo>
Jul 27 16:52:09 user nova-compute[71026]:   <os>
Jul 27 16:52:09 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:52:09 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:52:09 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:52:09 user nova-compute[71026]:   </os>
Jul 27 16:52:09 user nova-compute[71026]:   <features>
Jul 27 16:52:09 user nova-compute[71026]:     <acpi/>
Jul 27 16:52:09 user nova-compute[71026]:     <apic/>
Jul 27 16:52:09 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:52:09 user nova-compute[71026]:   </features>
Jul 27 16:52:09 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:52:09 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:52:09 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:52:09 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:52:09 user nova-compute[71026]:   </clock>
Jul 27 16:52:09 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:52:09 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:52:09 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:52:09 user nova-compute[71026]:   </cpu>
Jul 27 16:52:09 user nova-compute[71026]:   <devices>
Jul 27 16:52:09 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:52:09 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:52:09 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk"/>
Jul 27 16:52:09 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:52:09 user nova-compute[71026]:     </disk>
Jul 27 16:52:09 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:52:09 user nova-compute[71026]:       <mac address="fa:16:3e:92:e9:89"/>
Jul 27 16:52:09 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:52:09 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:52:09 user nova-compute[71026]:       <target dev="tapd4d5e45c-b2"/>
Jul 27 16:52:09 user nova-compute[71026]:     </interface>
Jul 27 16:52:09 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:52:09 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/console.log" append="off"/>
Jul 27 16:52:09 user nova-compute[71026]:     </serial>
Jul 27 16:52:09 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:52:09 user nova-compute[71026]:     <video>
Jul 27 16:52:09 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:52:09 user nova-compute[71026]:     </video>
Jul 27 16:52:09 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:52:09 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:52:09 user nova-compute[71026]:     </rng>
Jul 27 16:52:09 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:52:09 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:52:09 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:52:09 user nova-compute[71026]:     </memballoon>
Jul 27 16:52:09 user nova-compute[71026]:   </devices>
Jul 27 16:52:09 user nova-compute[71026]: </domain>
Jul 27 16:52:09 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Cannot resize image /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'migration_context' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG os_vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d5e45c-b2, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d5e45c-b2, col_values=(('external_ids', {'iface-id': 'd4d5e45c-b26e-492f-9a92-f0bc0c120325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:e9:89', 'vm-uuid': '95dcc9cc-42b0-413a-acd8-921a1197c8d9'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:52:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:10 user nova-compute[71026]: INFO os_vif [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:52:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:52:11 user nova-compute[71026]: WARNING nova.compute.manager [req-0c92c328-68bb-4f46-9eea-5d78de1b8923 req-1ee4f83c-5447-4112-b6ed-a7fd98df25fb service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state stopped and task_state powering-on.
Jul 27 16:52:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476733.7415035, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:52:13 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Resumed (Lifecycle Event)
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:52:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance rebooted successfully.
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-223852b2-8a93-4b74-9500-ff007802755e tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:52:13 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476733.7431047, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:52:13 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Started (Lifecycle Event)
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:52:13 user nova-compute[71026]: WARNING nova.compute.manager [req-f52ed308-ac5f-4d6d-8d27-8f608d62a8d5 req-fd16f074-43db-42cc-870b-1f6a42601509 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state active and task_state None.
Jul 27 16:52:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:52:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.67544174194336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 113be118-e8ae-4ee2-b2d8-13636b535813 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:52:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:52:29 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:52:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [{"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-3037d3ff-300a-42b0-a022-3aa1e9df52a6" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:52:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:52:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-changed-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Refreshing instance network info cache due to event network-changed-b297c225-06ba-41c2-a098-b4c3b66e27b3. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:52:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] Acquiring lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:52:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] Acquired lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:52:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Refreshing network info cache for port b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:54 user nova-compute[71026]: INFO nova.compute.manager [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Terminating instance
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updated VIF entry in instance network info cache for port b297c225-06ba-41c2-a098-b4c3b66e27b3. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updating instance_info_cache with network_info: [{"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7398b3a6-5a0a-49c2-8a83-43e704e2bc85 req-bce785e8-e890-4cf1-8ada-2876650a6d98 service nova] Releasing lock "refresh_cache-113be118-e8ae-4ee2-b2d8-13636b535813" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-unplugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] No waiting events found dispatching network-vif-unplugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-149a0318-047d-4022-9b04-030dfc2def57 req-05f8a4b2-def2-46e6-9f1f-e8a2bda32aa6 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-unplugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Instance destroyed successfully.
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid 113be118-e8ae-4ee2-b2d8-13636b535813 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2144855537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2144855537',id=29,image_ref='00b3a8bd-8c77-4e8f-ade4-71b8a7f399ed',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhSJA5b+2VOb8lSfeHNkg7TUih+4A2B25CQvS564Es5zoYNktJpCCwZIEvga8AJ79GRxarhtIEMIeO/yT+G3DAPH11R7LqyqDpWXW1nF66uvjh+lVoO6Ad+spArJ7HvgQ==',key_name='tempest-keypair-230078257',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:51:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-4dzw0fon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2066891657',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:51:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=113be118-e8ae-4ee2-b2d8-13636b535813,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "address": "fa:16:3e:c8:43:ef", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb297c225-06", "ovs_interfaceid": "b297c225-06ba-41c2-a098-b4c3b66e27b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_vif [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb297c225-06, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:52:54 user nova-compute[71026]: INFO os_vif [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:43:ef,bridge_name='br-int',has_traffic_filtering=True,id=b297c225-06ba-41c2-a098-b4c3b66e27b3,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb297c225-06')
Jul 27 16:52:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIhcEQnH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:52:54 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe62d93d-7dcf-4630-91e9-c6ed6659e93f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:52:54 user nova-compute[71026]: No targets found.
Jul 27 16:52:54 user nova-compute[71026]: iSNS:
Jul 27 16:52:54 user nova-compute[71026]: No targets found.
Jul 27 16:52:54 user nova-compute[71026]: STATIC:
Jul 27 16:52:54 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c
Jul 27 16:52:54 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:52:54 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:52:54 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:52:54 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:52:54 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:52:54 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d
Jul 27 16:52:54 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:52:54 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:52:54 user nova-compute[71026]: FIRMWARE:
Jul 27 16:52:54 user nova-compute[71026]: No targets found.
Jul 27 16:52:54 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:52:54 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:52:54 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6a02f1-7b6c-44fa-850e-af59b00f0695]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2159654-ad41-4707-91dc-45863655d630]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:52:55 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:52:55 user nova-compute[71026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)
Jul 27 16:52:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:52:55 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:52:55 user nova-compute[71026]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d (non-flash)
Jul 27 16:52:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30b73d5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65ee2a-850c-4f95-ba62-2a4d97c08dc6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6fde6b-1a0d-4421-b478-bc1ab91f4791]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fcec60-9379-4bd9-98df-ee2b8325b60a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a593e8a6-bb6b-4c63-9454-0027dfdcd0ea]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO95cce269-dc61e17147fe0ec1', '/dev/disk/by-id/scsi-26463363165313731', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_95cce269') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da719d-a212-4228-921d-0210cf9db848]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a0a12-e0bc-42ba-96a3-0d20f2e38e04]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e83666d-643c-43f3-8e24-9a8ce1f50c28]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260]
Jul 27 16:52:55 user nova-compute[71026]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d, portal: 172.16.0.220,3260] successful.
Jul 27 16:52:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8712f7d-3684-431d-988e-5a1ae3d24b8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b3463d-cd07-48c6-a52d-c47fe6444c61]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (328ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:52:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Deleting instance files /opt/stack/data/nova/instances/113be118-e8ae-4ee2-b2d8-13636b535813_del
Jul 27 16:52:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Deletion of /opt/stack/data/nova/instances/113be118-e8ae-4ee2-b2d8-13636b535813_del complete
Jul 27 16:52:55 user nova-compute[71026]: INFO nova.compute.manager [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Took 1.19 seconds to destroy the instance on the hypervisor.
Jul 27 16:52:55 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:52:55 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:52:56 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:52:56 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Took 0.89 seconds to deallocate network for instance.
Jul 27 16:52:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] Acquiring lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] Lock "113be118-e8ae-4ee2-b2d8-13636b535813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] No waiting events found dispatching network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:52:56 user nova-compute[71026]: WARNING nova.compute.manager [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received unexpected event network-vif-plugged-b297c225-06ba-41c2-a098-b4c3b66e27b3 for instance with vm_state active and task_state deleting.
Jul 27 16:52:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-f1f9ca1e-a6d3-42a0-90de-c69a5ae53cf3 req-53d7e1a7-dca8-478f-ae0c-8fc6922f2142 service nova] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Received event network-vif-deleted-b297c225-06ba-41c2-a098-b4c3b66e27b3 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:52:56 user nova-compute[71026]: INFO nova.compute.manager [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Took 0.78 seconds to detach 1 volumes for instance.
Jul 27 16:52:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Deleting volume: f8712f7d-3684-431d-988e-5a1ae3d24b8d {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:52:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:57 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:52:57 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:52:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:57 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance 113be118-e8ae-4ee2-b2d8-13636b535813
Jul 27 16:52:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d4625cbf-b85b-4160-adc4-a88aa2083af6 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "113be118-e8ae-4ee2-b2d8-13636b535813" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.341s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:52:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:52:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:52:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:52:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:53:00 user nova-compute[71026]: INFO nova.compute.claims [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Claim successful on node user
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:53:00 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:53:00 user nova-compute[71026]: INFO nova.virt.block_device [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Booting with blank volume at /dev/vda
Jul 27 16:53:00 user nova-compute[71026]: DEBUG nova.policy [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c742ca26757400288ef69caac251d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbbd8fb9af44b38b4c48be901f137a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:53:01 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Successfully created port: fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Successfully updated port: fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-changed-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Refreshing instance network info cache due to event network-changed-fcc5b255-cc94-4709-9763-1af6e20033f5. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.network.neutron [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance network_info: |[{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:53:02 user nova-compute[71026]: DEBUG nova.network.neutron [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Refreshing network info cache for port fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:53:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updated VIF entry in instance network info cache for port fcc5b255-cc94-4709-9763-1af6e20033f5. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:53:03 user nova-compute[71026]: DEBUG nova.network.neutron [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:53:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4c81368-8938-41b6-b520-36899b6a3069 req-252158cd-4737-4358-b4e7-5918d7063592 service nova] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:53:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.utils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c51af-b2cd-4259-a7bf-038511c42d6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb62b4e-6c10-4801-ba85-2f7ee1bd553b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9af2d79-dce6-4d34-a5f6-5b4a746d14ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca83b420-b201-43a0-849f-baea2fb14c63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:53:06 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:53:06 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5670cee-aec5-4082-9140-93e6a37ce105]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG os_brick.utils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:53:06 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating existing volume attachment record: ac9f151c-076c-40d2-91d6-169edbbcaf4b {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476774.872063, 113be118-e8ae-4ee2-b2d8-13636b535813 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:53:09 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] VM Stopped (Lifecycle Event)
Jul 27 16:53:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b56419a3-6eed-4b10-8da6-c863605e3f4c None None] [instance: 113be118-e8ae-4ee2-b2d8-13636b535813] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:53:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Creating image(s)
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Ensure instance console log exists: /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start _get_guest_xml network_info=[{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ac9f151c-076c-40d2-91d6-169edbbcaf4b', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84e41b88-163b-46c2-8b8b-226afc0b3e1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd55e1351-28e7-4ede-9e8c-6956f9b9068f', 'serial': 'd55e1351-28e7-4ede-9e8c-6956f9b9068f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:53:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:53:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:53:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:53:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:53:13 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcdc9b2-1183-4a31-9baa-038921622d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:53:13 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95f2c8-a1b1-4c2f-a647-e136fe1ce3ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f] added
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c16e3d-b602-4b1d-a9fa-1dc8860630a0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d5b9f-00b7-4a92-bd20-9a5bc00b8221]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWjtiMeE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWjtiMeE" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[154c637b-4d2e-4cb1-bacb-3c617a4f43b1]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWjtiMeE'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6585b054-68c2-44f8-9344-9ec330c86568]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eced61-9dac-4307-95da-b757fd1f4ed4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[190a7a91-9b63-4810-8a62-4febb458f836]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260]
Jul 27 16:53:13 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260] successful.
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e997b2-d31e-424b-8f9f-8bc592e0e4dd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b842316-74fb-45e7-96ef-adb8ed280a00]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:13 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:53:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b305d0-d6a0-4d5c-bcfb-e31082352767]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23162323737323039', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162323737323039', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157991698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157991698',id=30,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-zfdb5cji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:53:01Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=84e41b88-163b-46c2-8b8b-226afc0b3e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:53:14 user nova-compute[71026]:   <uuid>84e41b88-163b-46c2-8b8b-226afc0b3e1a</uuid>
Jul 27 16:53:14 user nova-compute[71026]:   <name>instance-0000001e</name>
Jul 27 16:53:14 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:53:14 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:53:14 user nova-compute[71026]:   <metadata>
Jul 27 16:53:14 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:53:14 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-157991698</nova:name>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:53:13</nova:creationTime>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:53:14 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:53:14 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:owner>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 16:53:14 user nova-compute[71026]:       </nova:owner>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:53:14 user nova-compute[71026]:       <nova:ports>
Jul 27 16:53:14 user nova-compute[71026]:         <nova:port uuid="fcc5b255-cc94-4709-9763-1af6e20033f5">
Jul 27 16:53:14 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:53:14 user nova-compute[71026]:         </nova:port>
Jul 27 16:53:14 user nova-compute[71026]:       </nova:ports>
Jul 27 16:53:14 user nova-compute[71026]:     </nova:instance>
Jul 27 16:53:14 user nova-compute[71026]:   </metadata>
Jul 27 16:53:14 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:53:14 user nova-compute[71026]:     <system>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="serial">84e41b88-163b-46c2-8b8b-226afc0b3e1a</entry>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="uuid">84e41b88-163b-46c2-8b8b-226afc0b3e1a</entry>
Jul 27 16:53:14 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:53:14 user nova-compute[71026]:     </system>
Jul 27 16:53:14 user nova-compute[71026]:   </sysinfo>
Jul 27 16:53:14 user nova-compute[71026]:   <os>
Jul 27 16:53:14 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:53:14 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:53:14 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:53:14 user nova-compute[71026]:   </os>
Jul 27 16:53:14 user nova-compute[71026]:   <features>
Jul 27 16:53:14 user nova-compute[71026]:     <acpi/>
Jul 27 16:53:14 user nova-compute[71026]:     <apic/>
Jul 27 16:53:14 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:53:14 user nova-compute[71026]:   </features>
Jul 27 16:53:14 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:53:14 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:53:14 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:53:14 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:53:14 user nova-compute[71026]:   </clock>
Jul 27 16:53:14 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:53:14 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:53:14 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:53:14 user nova-compute[71026]:   </cpu>
Jul 27 16:53:14 user nova-compute[71026]:   <devices>
Jul 27 16:53:14 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:53:14 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:53:14 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:53:14 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:53:14 user nova-compute[71026]:       <serial>d55e1351-28e7-4ede-9e8c-6956f9b9068f</serial>
Jul 27 16:53:14 user nova-compute[71026]:     </disk>
Jul 27 16:53:14 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:53:14 user nova-compute[71026]:       <mac address="fa:16:3e:58:d2:a5"/>
Jul 27 16:53:14 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:53:14 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:53:14 user nova-compute[71026]:       <target dev="tapfcc5b255-cc"/>
Jul 27 16:53:14 user nova-compute[71026]:     </interface>
Jul 27 16:53:14 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:53:14 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/console.log" append="off"/>
Jul 27 16:53:14 user nova-compute[71026]:     </serial>
Jul 27 16:53:14 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:53:14 user nova-compute[71026]:     <video>
Jul 27 16:53:14 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:53:14 user nova-compute[71026]:     </video>
Jul 27 16:53:14 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:53:14 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:53:14 user nova-compute[71026]:     </rng>
Jul 27 16:53:14 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:53:14 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:53:14 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:53:14 user nova-compute[71026]:     </memballoon>
Jul 27 16:53:14 user nova-compute[71026]:   </devices>
Jul 27 16:53:14 user nova-compute[71026]: </domain>
Jul 27 16:53:14 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157991698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157991698',id=30,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-zfdb5cji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:53:01Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=84e41b88-163b-46c2-8b8b-226afc0b3e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG os_vif [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcc5b255-cc, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcc5b255-cc, col_values=(('external_ids', {'iface-id': 'fcc5b255-cc94-4709-9763-1af6e20033f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:d2:a5', 'vm-uuid': '84e41b88-163b-46c2-8b8b-226afc0b3e1a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:14 user nova-compute[71026]: INFO os_vif [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc')
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:53:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:58:d2:a5, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:53:16 user nova-compute[71026]: WARNING nova.compute.manager [req-c54e2dc6-caa7-4204-8c8a-6470cf14db86 req-ad69d8da-5b00-42c2-bdbb-b30fca0d0ae0 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state building and task_state spawning.
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476798.3282385, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Resumed (Lifecycle Event)
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance spawned successfully.
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476798.3289025, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Started (Lifecycle Event)
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Took 5.13 seconds to spawn the instance on the hypervisor.
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:53:18 user nova-compute[71026]: INFO nova.compute.manager [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Took 18.50 seconds to build instance.
Jul 27 16:53:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-58a9a02f-6ed7-4bfc-88c3-c6e450603cef tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.603s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:53:18 user nova-compute[71026]: WARNING nova.compute.manager [req-72c2e3da-14b8-44a1-a7c7-6b517e07c1c8 req-8205781c-66cb-4008-861c-97b4065584f8 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state active and task_state None.
Jul 27 16:53:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:53:28 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.67206573486328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:53:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [{"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-95dcc9cc-42b0-413a-acd8-921a1197c8d9" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:53:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:31 user nova-compute[71026]: INFO nova.compute.manager [None req-0c103bd9-40c1-4844-9ee8-35e089ec5148 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Get console output
Jul 27 16:53:31 user nova-compute[71026]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 27 16:53:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:53:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:53:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:48 user nova-compute[71026]: INFO nova.compute.manager [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Terminating instance
Jul 27 16:53:48 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-unplugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] No waiting events found dispatching network-vif-unplugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-09200b62-a63b-44ad-8c62-89c16c62c7f1 req-7f971aaf-d4a9-44f0-b4dd-88c45f80bcc9 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-unplugged-721c9544-64e0-447e-b6e7-d0d63e258060 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Instance destroyed successfully.
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:49:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-346459254',display_name='tempest-TestVolumeBootPattern-volume-backed-server-346459254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-346459254',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTv8s0XmlWaqzVsbwWNm4z/rQe8L4o9Z23JaTvQ0oEIyLfFkzLUKJ9JXigJ366ZseT+sHm/zysYOd9LFEmZTgL93PRJabmQQiFqjnOBPvHix0WhBPLLifFX3kfwM6c7tg==',key_name='tempest-keypair-2144241389',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-d7iohvk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:49:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "721c9544-64e0-447e-b6e7-d0d63e258060", "address": "fa:16:3e:35:3d:4a", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap721c9544-64", "ovs_interfaceid": "721c9544-64e0-447e-b6e7-d0d63e258060", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_vif [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap721c9544-64, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:53:49 user nova-compute[71026]: INFO os_vif [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:3d:4a,bridge_name='br-int',has_traffic_filtering=True,id=721c9544-64e0-447e-b6e7-d0d63e258060,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap721c9544-64')
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbNrfJqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:53:49 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d64605-0ee7-44f7-b89e-6d04d85a350a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:53:49 user nova-compute[71026]: No targets found.
Jul 27 16:53:49 user nova-compute[71026]: iSNS:
Jul 27 16:53:49 user nova-compute[71026]: No targets found.
Jul 27 16:53:49 user nova-compute[71026]: STATIC:
Jul 27 16:53:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c
Jul 27 16:53:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:53:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:53:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:53:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:53:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:53:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:53:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:53:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:53:49 user nova-compute[71026]: FIRMWARE:
Jul 27 16:53:49 user nova-compute[71026]: No targets found.
Jul 27 16:53:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:53:49 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:53:49 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15204d88-ef70-4337-b6d2-9cdb94e63dd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6e476-2614-4847-9813-00e741719ebf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:49 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:49 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:53:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c (non-flash)
Jul 27 16:53:49 user nova-compute[71026]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:53:49 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:53:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a82293f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c'): ({'sde'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sde {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812884b-3f74-4af2-b587-8daa5a189e5a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193564f-40fa-4bcb-97e9-441e7c250435]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sde {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e252497-618d-4c22-919f-aa24e1b620de]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.092s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921c288-9023-4a70-b0a8-c06c0637f685]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee98de-775d-4b4e-b49c-c0f30b454ca4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8db138e-9c4a-4a34-89b7-17c274b0375b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260]
Jul 27 16:53:49 user nova-compute[71026]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c, portal: 172.16.0.220,3260] successful.
Jul 27 16:53:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2274621d-842d-4f87-a14c-b19d66a2c83c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d801c4b1-ae47-4315-ae70-34bcc3139dab]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (364ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:53:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:53:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Deleting instance files /opt/stack/data/nova/instances/bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24_del
Jul 27 16:53:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Deletion of /opt/stack/data/nova/instances/bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24_del complete
Jul 27 16:53:50 user nova-compute[71026]: INFO nova.compute.manager [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 16:53:50 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:53:50 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:53:50 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:53:50 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:53:50 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Took 0.95 seconds to deallocate network for instance.
Jul 27 16:53:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-65612909-5d21-4a54-a60c-14e59b4abda0 req-9413f04e-f7a4-4ffd-a37e-0ae4dbc71020 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-deleted-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:50 user nova-compute[71026]: INFO nova.compute.manager [req-65612909-5d21-4a54-a60c-14e59b4abda0 req-9413f04e-f7a4-4ffd-a37e-0ae4dbc71020 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Neutron deleted interface 721c9544-64e0-447e-b6e7-d0d63e258060; detaching it from the instance and deleting it from the info cache
Jul 27 16:53:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-65612909-5d21-4a54-a60c-14e59b4abda0 req-9413f04e-f7a4-4ffd-a37e-0ae4dbc71020 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-65612909-5d21-4a54-a60c-14e59b4abda0 req-9413f04e-f7a4-4ffd-a37e-0ae4dbc71020 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Detach interface failed, port_id=721c9544-64e0-447e-b6e7-d0d63e258060, reason: Instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] Acquiring lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] No waiting events found dispatching network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:53:51 user nova-compute[71026]: WARNING nova.compute.manager [req-889d2fd9-0266-47cc-bdbe-2c45c9c4748b req-5791c823-8e06-490a-bc66-f0c5d6ad31a8 service nova] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Received unexpected event network-vif-plugged-721c9544-64e0-447e-b6e7-d0d63e258060 for instance with vm_state active and task_state deleting.
Jul 27 16:53:51 user nova-compute[71026]: INFO nova.compute.manager [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Took 0.73 seconds to detach 1 volumes for instance.
Jul 27 16:53:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Deleting volume: 2274621d-842d-4f87-a14c-b19d66a2c83c {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:53:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:53:52 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:53:52 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:53:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:52 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24
Jul 27 16:53:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bb7714e5-1c08-432b-947c-45dda3336744 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.411s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:53:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:53:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:00 user nova-compute[71026]: INFO nova.compute.manager [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Terminating instance
Jul 27 16:54:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-46cfffc0-d307-4bc1-84d0-3ea7397dd123 req-e82252c6-f813-475d-8a91-788dacf7688e service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-unplugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Instance destroyed successfully.
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'resources' on Instance uuid 95dcc9cc-42b0-413a-acd8-921a1197c8d9 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:44:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-904067667',display_name='tempest-AttachVolumeTestJSON-server-904067667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-904067667',id=22,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7qOIgHVEvDR1iEVqdY4avKNi+DQ1ZVTBt/dC9gx9hNuR8esBIvQT6CkjSxM7fcfevRsmualTyuVYHkjvJlhvVRfQnSjSz0mHxz9qifDdyLigonjMlGSvmZRyheifUKHw==',key_name='tempest-keypair-1921216439',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:44:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-6tm4fyks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=95dcc9cc-42b0-413a-acd8-921a1197c8d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "address": "fa:16:3e:92:e9:89", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d5e45c-b2", "ovs_interfaceid": "d4d5e45c-b26e-492f-9a92-f0bc0c120325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG os_vif [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d5e45c-b2, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:01 user nova-compute[71026]: INFO os_vif [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:e9:89,bridge_name='br-int',has_traffic_filtering=True,id=d4d5e45c-b26e-492f-9a92-f0bc0c120325,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d5e45c-b2')
Jul 27 16:54:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Deleting instance files /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9_del
Jul 27 16:54:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Deletion of /opt/stack/data/nova/instances/95dcc9cc-42b0-413a-acd8-921a1197c8d9_del complete
Jul 27 16:54:01 user nova-compute[71026]: INFO nova.compute.manager [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 16:54:01 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:54:01 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:01 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Took 0.87 seconds to deallocate network for instance.
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:02 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Deleted allocations for instance 95dcc9cc-42b0-413a-acd8-921a1197c8d9
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-97f2aca8-28ee-474a-88b7-6ef055dc2cb6 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.179s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] Acquiring lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] Lock "95dcc9cc-42b0-413a-acd8-921a1197c8d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] No waiting events found dispatching network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:02 user nova-compute[71026]: WARNING nova.compute.manager [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received unexpected event network-vif-plugged-d4d5e45c-b26e-492f-9a92-f0bc0c120325 for instance with vm_state deleted and task_state None.
Jul 27 16:54:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8341e76-c1c4-4815-8e21-def68835d257 req-9c1d1f30-47fd-4d4f-b5d2-99b80cc37ac4 service nova] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Received event network-vif-deleted-d4d5e45c-b26e-492f-9a92-f0bc0c120325 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:04 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476829.5439317, bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:54:04 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] VM Stopped (Lifecycle Event)
Jul 27 16:54:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1254dc01-07e4-4bd1-a5ac-283339fdd304 None None] [instance: bc5a621b-fb6d-4c7d-99eb-54ccf9b63b24] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:15 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476840.9984822, 95dcc9cc-42b0-413a-acd8-921a1197c8d9 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:54:16 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] VM Stopped (Lifecycle Event)
Jul 27 16:54:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0bd649dc-2d3c-4f9c-b94c-5d34b97005f5 None None] [instance: 95dcc9cc-42b0-413a-acd8-921a1197c8d9] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:23 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:28 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [{"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-0aa475ea-5c70-4ff6-9141-9b088dc52ebf" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8389MB free_disk=25.697452545166016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:54:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:32 user nova-compute[71026]: INFO nova.compute.manager [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Terminating instance
Jul 27 16:54:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-c8e98e71-1fd6-49b9-a9c2-2095865c18ec req-2dd9c2a1-70a7-4d37-91a1-8e4485dce296 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-unplugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Instance destroyed successfully.
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'resources' on Instance uuid 0aa475ea-5c70-4ff6-9141-9b088dc52ebf {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:47:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1255413258',display_name='tempest-ServerActionsTestOtherA-server-1255413258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1255413258',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-6j4ecxrm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=0aa475ea-5c70-4ff6-9141-9b088dc52ebf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "address": "fa:16:3e:4f:f4:03", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e29a1c-b6", "ovs_interfaceid": "16e29a1c-b62b-48b5-88d5-0666f4d72b5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_vif [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16e29a1c-b6, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:33 user nova-compute[71026]: INFO os_vif [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f4:03,bridge_name='br-int',has_traffic_filtering=True,id=16e29a1c-b62b-48b5-88d5-0666f4d72b5f,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e29a1c-b6')
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KXmwyHOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:54:33 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f55af1a-78d7-478d-8146-8269dc88189d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:54:33 user nova-compute[71026]: No targets found.
Jul 27 16:54:33 user nova-compute[71026]: iSNS:
Jul 27 16:54:33 user nova-compute[71026]: No targets found.
Jul 27 16:54:33 user nova-compute[71026]: STATIC:
Jul 27 16:54:33 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770
Jul 27 16:54:33 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:54:33 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:54:33 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:54:33 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:54:33 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:54:33 user nova-compute[71026]: FIRMWARE:
Jul 27 16:54:33 user nova-compute[71026]: No targets found.
Jul 27 16:54:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:54:33 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:54:33 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84512c8a-c15e-4faa-8936-b679a241b1a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177ec0a-edb1-433f-b8b5-2657c36a92f4]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:54:33 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 (non-flash)
Jul 27 16:54:33 user nova-compute[71026]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80b35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[161c6732-9fe3-4498-a890-0fa30e04e894]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c877bc92-08e1-4100-a465-701517c77b47]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff35566b-f221-4d71-a60c-a7a8e471124a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c478e6-6a73-43a0-aa98-50d8da8f1e39]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc383074a-b471862727d27515', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c383074a', '/dev/disk/by-id/scsi-26234373138363237') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[253c3c96-d1e1-4500-a855-083766264fe4]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3828601-3869-4e61-a4b9-2286d739ce2b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84099d47-cc50-4d26-aeee-3550b101cd88]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260]
Jul 27 16:54:33 user nova-compute[71026]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770, portal: 172.16.0.220,3260] successful.
Jul 27 16:54:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d44e8cd6-67bc-4314-80de-998240af7770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df202c8-0853-4470-bcb2-2fc9ae136bd7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] <== disconnect_volume: return (302ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:54:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Deleting instance files /opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf_del
Jul 27 16:54:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Deletion of /opt/stack/data/nova/instances/0aa475ea-5c70-4ff6-9141-9b088dc52ebf_del complete
Jul 27 16:54:33 user nova-compute[71026]: INFO nova.compute.manager [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 16:54:33 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:54:33 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:34 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Took 0.98 seconds to deallocate network for instance.
Jul 27 16:54:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] Acquiring lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] No waiting events found dispatching network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:34 user nova-compute[71026]: WARNING nova.compute.manager [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received unexpected event network-vif-plugged-16e29a1c-b62b-48b5-88d5-0666f4d72b5f for instance with vm_state active and task_state deleting.
Jul 27 16:54:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-3c7147ca-b58a-45fb-afef-6bbf1658c6e2 req-e2e6b4a2-17ae-4069-bf58-44a14c3d7f73 service nova] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Received event network-vif-deleted-16e29a1c-b62b-48b5-88d5-0666f4d72b5f {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:35 user nova-compute[71026]: INFO nova.compute.manager [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Took 0.75 seconds to detach 1 volumes for instance.
Jul 27 16:54:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Deleting volume: d44e8cd6-67bc-4314-80de-998240af7770 {{(pid=71026) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:35 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Deleted allocations for instance 0aa475ea-5c70-4ff6-9141-9b088dc52ebf
Jul 27 16:54:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ce1c7e4-8ec5-4572-96a1-abf56302a0b7 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "0aa475ea-5c70-4ff6-9141-9b088dc52ebf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.386s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:54:48 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476873.3724706, 0aa475ea-5c70-4ff6-9141-9b088dc52ebf => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:54:48 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] VM Stopped (Lifecycle Event)
Jul 27 16:54:48 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f142ca2a-e38c-491e-a4c8-73221cc58d62 None None] [instance: 0aa475ea-5c70-4ff6-9141-9b088dc52ebf] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:54:50 user nova-compute[71026]: INFO nova.compute.claims [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Claim successful on node user
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:54:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:54:50 user nova-compute[71026]: INFO nova.virt.block_device [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Booting with volume 00cf60fe-05fc-4be0-9628-ed934f1ab1ea at /dev/vda
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.policy [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3b0b6-0842-40d3-a328-de0572261618]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[76afd028-db34-4a8f-901a-ff6a5f986211]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[550fa7ef-d1f4-4501-879f-b8980bd94a0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[40143b02-c77c-4037-b43c-10b1e98ecb7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:54:50 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:54:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f49cc-c07d-49db-b9ea-868e401a5dd2]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:54:50 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updating existing volume attachment record: d87ca8b5-0e81-4775-8f08-bf3e484e37d3 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:54:51 user nova-compute[71026]: INFO nova.compute.manager [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Rescuing
Jul 27 16:54:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Successfully created port: fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:52 user nova-compute[71026]: WARNING nova.compute.manager [req-7b7824a5-f2b9-4dcb-b0b4-167c2985c0f0 req-423b14d8-24af-49b7-a16b-d5cdd2f59634 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state active and task_state rescuing.
Jul 27 16:54:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance destroyed successfully.
Jul 27 16:54:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Attempting a stable device rescue
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Successfully updated port: fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 16:54:52 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Creating image(s)
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "259b2d5081d213cf375a772959e4f811adf047e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "259b2d5081d213cf375a772959e4f811adf047e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-changed-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Refreshing instance network info cache due to event network-changed-fc94fb78-23da-4c3d-b67a-2253c062a00b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:54:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] Acquiring lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG nova.virt.images [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] 1340d972-8cac-49b1-bff0-38d205a2449b was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:54:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.part /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:54 user nova-compute[71026]: WARNING nova.compute.manager [req-86cba940-df22-4b24-ac82-6146a77d98de req-a18887c4-1381-4f05-be8b-fe1b6c7aab6c service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state active and task_state rescuing.
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updating instance_info_cache with network_info: [{"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Instance network_info: |[{"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] Acquired lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.network.neutron [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Refreshing network info cache for port fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.part /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.converted" returned: 0 in 0.654s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "259b2d5081d213cf375a772959e4f811adf047e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.107s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "259b2d5081d213cf375a772959e4f811adf047e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "259b2d5081d213cf375a772959e4f811adf047e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6 --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6,backing_fmt=raw /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6,backing_fmt=raw /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue" returned: 0 in 0.072s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "259b2d5081d213cf375a772959e4f811adf047e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:54 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'migration_context' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start _get_guest_xml network_info=[{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:58:d2:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1340d972-8cac-49b1-bff0-38d205a2449b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ac9f151c-076c-40d2-91d6-169edbbcaf4b', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '84e41b88-163b-46c2-8b8b-226afc0b3e1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd55e1351-28e7-4ede-9e8c-6956f9b9068f', 'serial': 'd55e1351-28e7-4ede-9e8c-6956f9b9068f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:54:55 user nova-compute[71026]: INFO nova.compute.claims [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Claim successful on node user
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'numa_topology' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updated VIF entry in instance network info cache for port fc94fb78-23da-4c3d-b67a-2253c062a00b. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updating instance_info_cache with network_info: [{"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:54:55 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:54:55 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:54:55 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ce1a708e-77d7-4155-b7c5-941ceb91ee30 req-fd1b6b3c-5e7f-4364-b9eb-6bff1e7c837d service nova] Releasing lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d654d3-2c5a-4550-85e6-f1d0b8f79312]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LWjtiMeE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 16:54:55 user nova-compute[71026]: node.name = iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:54:55 user nova-compute[71026]: node.tpgt = -1
Jul 27 16:54:55 user nova-compute[71026]: node.startup = automatic
Jul 27 16:54:55 user nova-compute[71026]: node.leading_login = No
Jul 27 16:54:55 user nova-compute[71026]: iface.iscsi_ifacename = default
Jul 27 16:54:55 user nova-compute[71026]: iface.net_ifacename = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.ipaddress = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.prefix_len = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.hwaddress = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.transport_name = tcp
Jul 27 16:54:55 user nova-compute[71026]: iface.initiatorname = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.vlan_id = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.vlan_priority = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.vlan_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.iface_num = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.mtu = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.port = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.bootproto = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.subnet_mask = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.gateway = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_alt_client_id = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_dns = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_learn_iqn = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_vendor_id_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_vendor_id = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.dhcp_slp_da = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.fragmentation = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.gratuitous_arp = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.incoming_forwarding = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.tos_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.tos = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.ttl = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.delayed_ack = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.tcp_nagle = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.tcp_wsf_state = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.tcp_wsf = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.tcp_timer_scale = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.tcp_timestamp = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.redirect = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.def_task_mgmt_timeout = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.header_digest = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.data_digest = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.immediate_data = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.initial_r2t = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.data_seq_inorder = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.data_pdu_inorder = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.erl = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.max_receive_data_len = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.first_burst_len = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.max_outstanding_r2t = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.max_burst_len = 0
Jul 27 16:54:55 user nova-compute[71026]: iface.chap_auth = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.bidi_chap = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.strict_login_compliance = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.discovery_auth = <empty>
Jul 27 16:54:55 user nova-compute[71026]: iface.discovery_logout = <empty>
Jul 27 16:54:55 user nova-compute[71026]: node.discovery_address = <empty>
Jul 27 16:54:55 user nova-compute[71026]: node.discovery_port = 0
Jul 27 16:54:55 user nova-compute[71026]: node.discovery_type = static
Jul 27 16:54:55 user nova-compute[71026]: node.session.initial_cmdsn = 0
Jul 27 16:54:55 user nova-compute[71026]: node.session.initial_login_retry_max = 8
Jul 27 16:54:55 user nova-compute[71026]: node.session.xmit_thread_priority = -20
Jul 27 16:54:55 user nova-compute[71026]: node.session.cmds_max = 128
Jul 27 16:54:55 user nova-compute[71026]: node.session.queue_depth = 32
Jul 27 16:54:55 user nova-compute[71026]: node.session.nr_sessions = 1
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.authmethod = CHAP
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.username = LWjtiMeE
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.password = ***
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.username_in = <empty>
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.password_in = <empty>
Jul 27 16:54:55 user nova-compute[71026]: node.session.auth.chap_algs = MD5
Jul 27 16:54:55 user nova-compute[71026]: node.session.timeo.replacement_timeout = 120
Jul 27 16:54:55 user nova-compute[71026]: node.session.err_timeo.abort_timeout = 15
Jul 27 16:54:55 user nova-compute[71026]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 16:54:55 user nova-compute[71026]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 16:54:55 user nova-compute[71026]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.FastAbort = Yes
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.InitialR2T = No
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.ImmediateData = Yes
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.MaxConnections = 1
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 16:54:55 user nova-compute[71026]: node.session.iscsi.ERL = 0
Jul 27 16:54:55 user nova-compute[71026]: node.session.scan = manual
Jul 27 16:54:55 user nova-compute[71026]: node.session.reopen_max = 0
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].address = 172.16.0.220
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].port = 3260
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].startup = manual
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].tcp.window_size = 524288
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].tcp.type_of_service = 0
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].timeo.logout_timeout = 15
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].timeo.login_timeout = 15
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].timeo.auth_timeout = 45
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.DataDigest = None
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.IFMarker = No
Jul 27 16:54:55 user nova-compute[71026]: node.conn[0].iscsi.OFMarker = No
Jul 27 16:54:55 user nova-compute[71026]: # END RECORD
Jul 27 16:54:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec57cad1-58e7-4eb0-b873-c12a02a85883]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc17de65-4fdd-4936-81bc-c7bfa433f4ff]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWjtiMeE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LWjtiMeE" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab2c8c8-159e-409f-8054-71409aec4bff]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LWjtiMeE'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02135002-75f3-4230-a309-e36ef66ca085]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35447a10-4b05-4ba4-b897-1d90242b1120]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:55 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] HCTL ('34', '0', '0', 0) found on session 42 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75be5bf-ef63-4ad9-998a-1744ae6e1380]: (4, ('0 0 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 42 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== connect_volume: return (198ms) {'type': 'block', 'scsi_wwn': '23162323737323039', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162323737323039', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157991698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157991698',id=30,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-zfdb5cji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:53:19Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=84e41b88-163b-46c2-8b8b-226afc0b3e1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:58:d2:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:58:d2:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:54:55 user nova-compute[71026]:   <uuid>84e41b88-163b-46c2-8b8b-226afc0b3e1a</uuid>
Jul 27 16:54:55 user nova-compute[71026]:   <name>instance-0000001e</name>
Jul 27 16:54:55 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:54:55 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:54:55 user nova-compute[71026]:   <metadata>
Jul 27 16:54:55 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:54:55 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-157991698</nova:name>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:54:55</nova:creationTime>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:54:55 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:54:55 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:owner>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 16:54:55 user nova-compute[71026]:       </nova:owner>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:54:55 user nova-compute[71026]:       <nova:ports>
Jul 27 16:54:55 user nova-compute[71026]:         <nova:port uuid="fcc5b255-cc94-4709-9763-1af6e20033f5">
Jul 27 16:54:55 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:54:55 user nova-compute[71026]:         </nova:port>
Jul 27 16:54:55 user nova-compute[71026]:       </nova:ports>
Jul 27 16:54:55 user nova-compute[71026]:     </nova:instance>
Jul 27 16:54:55 user nova-compute[71026]:   </metadata>
Jul 27 16:54:55 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:54:55 user nova-compute[71026]:     <system>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="serial">84e41b88-163b-46c2-8b8b-226afc0b3e1a</entry>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="uuid">84e41b88-163b-46c2-8b8b-226afc0b3e1a</entry>
Jul 27 16:54:55 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:54:55 user nova-compute[71026]:     </system>
Jul 27 16:54:55 user nova-compute[71026]:   </sysinfo>
Jul 27 16:54:55 user nova-compute[71026]:   <os>
Jul 27 16:54:55 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:54:55 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:54:55 user nova-compute[71026]:   </os>
Jul 27 16:54:55 user nova-compute[71026]:   <features>
Jul 27 16:54:55 user nova-compute[71026]:     <acpi/>
Jul 27 16:54:55 user nova-compute[71026]:     <apic/>
Jul 27 16:54:55 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:54:55 user nova-compute[71026]:   </features>
Jul 27 16:54:55 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:54:55 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:54:55 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:54:55 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:54:55 user nova-compute[71026]:   </clock>
Jul 27 16:54:55 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:54:55 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:54:55 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:54:55 user nova-compute[71026]:   </cpu>
Jul 27 16:54:55 user nova-compute[71026]:   <devices>
Jul 27 16:54:55 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:54:55 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:54:55 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 16:54:55 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:54:55 user nova-compute[71026]:       <serial>d55e1351-28e7-4ede-9e8c-6956f9b9068f</serial>
Jul 27 16:54:55 user nova-compute[71026]:     </disk>
Jul 27 16:54:55 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:54:55 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:54:55 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue"/>
Jul 27 16:54:55 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 16:54:55 user nova-compute[71026]:       <boot order="1"/>
Jul 27 16:54:55 user nova-compute[71026]:     </disk>
Jul 27 16:54:55 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:54:55 user nova-compute[71026]:       <mac address="fa:16:3e:58:d2:a5"/>
Jul 27 16:54:55 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:55 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:54:55 user nova-compute[71026]:       <target dev="tapfcc5b255-cc"/>
Jul 27 16:54:55 user nova-compute[71026]:     </interface>
Jul 27 16:54:55 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:54:55 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/console.log" append="off"/>
Jul 27 16:54:55 user nova-compute[71026]:     </serial>
Jul 27 16:54:55 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:54:55 user nova-compute[71026]:     <video>
Jul 27 16:54:55 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:55 user nova-compute[71026]:     </video>
Jul 27 16:54:55 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:54:55 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:54:55 user nova-compute[71026]:     </rng>
Jul 27 16:54:55 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:54:55 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:54:55 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:54:55 user nova-compute[71026]:     </memballoon>
Jul 27 16:54:55 user nova-compute[71026]:   </devices>
Jul 27 16:54:55 user nova-compute[71026]: </domain>
Jul 27 16:54:55 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:54:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance destroyed successfully.
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:58:d2:a5, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:54:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.policy [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c543c6c138ad482ca985d5a756f78334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a20fd76c514ce488f9467e5ec36012', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:54:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Creating image(s)
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "/opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "/opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk 1073741824" returned: 0 in 0.055s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.187s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Cannot resize image /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.objects.instance [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'migration_context' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Ensure instance console log exists: /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Successfully created port: ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:57 user nova-compute[71026]: WARNING nova.compute.manager [req-20be4dfe-804c-4ae6-9809-0100d12b3e7c req-1601b05e-553a-4ff2-9618-6d1bf8e66c89 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state active and task_state rescuing.
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Successfully updated port: ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquired lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-changed-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Refreshing instance network info cache due to event network-changed-ac310bea-ea42-4e3b-9d1f-a6cb0602a383. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:54:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] Acquiring lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating instance_info_cache with network_info: [{"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Releasing lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Instance network_info: |[{"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] Acquired lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Refreshing network info cache for port ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Start _get_guest_xml network_info=[{"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:54:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1170028898',display_name='tempest-AttachVolumeTestJSON-server-1170028898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1170028898',id=32,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4dsHA3dbCqmceWqAAHc7ZAzBQ3+0aVcL7LJjrty7C4GG4CozA/7lKVfmUKNALJzy/Q6OVXcTRY8u9676/quk8ZWa1FTfCRptRWvlf9fnb9CA7cAgHAycbzanADJV+CgA==',key_name='tempest-keypair-1488707525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-bln8jly4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:54:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:54:58 user nova-compute[71026]:   <uuid>9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c</uuid>
Jul 27 16:54:58 user nova-compute[71026]:   <name>instance-00000020</name>
Jul 27 16:54:58 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:54:58 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:54:58 user nova-compute[71026]:   <metadata>
Jul 27 16:54:58 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:54:58 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeTestJSON-server-1170028898</nova:name>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:54:58</nova:creationTime>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:54:58 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:54:58 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:owner>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:user uuid="c543c6c138ad482ca985d5a756f78334">tempest-AttachVolumeTestJSON-2013998243-project-member</nova:user>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:project uuid="c4a20fd76c514ce488f9467e5ec36012">tempest-AttachVolumeTestJSON-2013998243</nova:project>
Jul 27 16:54:58 user nova-compute[71026]:       </nova:owner>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:54:58 user nova-compute[71026]:       <nova:ports>
Jul 27 16:54:58 user nova-compute[71026]:         <nova:port uuid="ac310bea-ea42-4e3b-9d1f-a6cb0602a383">
Jul 27 16:54:58 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 16:54:58 user nova-compute[71026]:         </nova:port>
Jul 27 16:54:58 user nova-compute[71026]:       </nova:ports>
Jul 27 16:54:58 user nova-compute[71026]:     </nova:instance>
Jul 27 16:54:58 user nova-compute[71026]:   </metadata>
Jul 27 16:54:58 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:54:58 user nova-compute[71026]:     <system>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="serial">9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c</entry>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="uuid">9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c</entry>
Jul 27 16:54:58 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:54:58 user nova-compute[71026]:     </system>
Jul 27 16:54:58 user nova-compute[71026]:   </sysinfo>
Jul 27 16:54:58 user nova-compute[71026]:   <os>
Jul 27 16:54:58 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:54:58 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:54:58 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:54:58 user nova-compute[71026]:   </os>
Jul 27 16:54:58 user nova-compute[71026]:   <features>
Jul 27 16:54:58 user nova-compute[71026]:     <acpi/>
Jul 27 16:54:58 user nova-compute[71026]:     <apic/>
Jul 27 16:54:58 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:54:58 user nova-compute[71026]:   </features>
Jul 27 16:54:58 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:54:58 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:54:58 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:54:58 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:54:58 user nova-compute[71026]:   </clock>
Jul 27 16:54:58 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:54:58 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:54:58 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:54:58 user nova-compute[71026]:   </cpu>
Jul 27 16:54:58 user nova-compute[71026]:   <devices>
Jul 27 16:54:58 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:54:58 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:54:58 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk"/>
Jul 27 16:54:58 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:54:58 user nova-compute[71026]:     </disk>
Jul 27 16:54:58 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:54:58 user nova-compute[71026]:       <mac address="fa:16:3e:17:fe:ff"/>
Jul 27 16:54:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:58 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:54:58 user nova-compute[71026]:       <target dev="tapac310bea-ea"/>
Jul 27 16:54:58 user nova-compute[71026]:     </interface>
Jul 27 16:54:58 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:54:58 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/console.log" append="off"/>
Jul 27 16:54:58 user nova-compute[71026]:     </serial>
Jul 27 16:54:58 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:54:58 user nova-compute[71026]:     <video>
Jul 27 16:54:58 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:58 user nova-compute[71026]:     </video>
Jul 27 16:54:58 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:54:58 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:54:58 user nova-compute[71026]:     </rng>
Jul 27 16:54:58 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:54:58 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:54:58 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:54:58 user nova-compute[71026]:     </memballoon>
Jul 27 16:54:58 user nova-compute[71026]:   </devices>
Jul 27 16:54:58 user nova-compute[71026]: </domain>
Jul 27 16:54:58 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1170028898',display_name='tempest-AttachVolumeTestJSON-server-1170028898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1170028898',id=32,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4dsHA3dbCqmceWqAAHc7ZAzBQ3+0aVcL7LJjrty7C4GG4CozA/7lKVfmUKNALJzy/Q6OVXcTRY8u9676/quk8ZWa1FTfCRptRWvlf9fnb9CA7cAgHAycbzanADJV+CgA==',key_name='tempest-keypair-1488707525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-bln8jly4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:54:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_vif [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac310bea-ea, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac310bea-ea, col_values=(('external_ids', {'iface-id': 'ac310bea-ea42-4e3b-9d1f-a6cb0602a383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:fe:ff', 'vm-uuid': '9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:58 user nova-compute[71026]: INFO os_vif [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea')
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:54:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Creating image(s)
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Ensure instance console log exists: /opt/stack/data/nova/instances/8047b284-421c-40fd-804a-fcbe6eabf72f/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Start _get_guest_xml network_info=[{"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd87ca8b5-0e81-4775-8f08-bf3e484e37d3', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8047b284-421c-40fd-804a-fcbe6eabf72f', 'attached_at': '', 'detached_at': '', 'volume_id': '00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'serial': '00cf60fe-05fc-4be0-9628-ed934f1ab1ea'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:54:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:58 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:54:58 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:54:58 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:54:58 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No VIF found with MAC fa:16:3e:17:fe:ff, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3d9532-bc38-4f5a-8c3d-4c485a3af69c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:54:58 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf5995f-40fb-412e-8188-6539b47af340]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea] added
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8d737-acf3-45b9-8839-75e56b8b1ff3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98786d-fb25-43d1-89e9-5ae02fe331b9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIXsEyBR {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIXsEyBR" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38059cd3-5cf8-4fe4-a33a-5313f5b6cf75]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIXsEyBR'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc10c9-e302-4899-91e6-7ef4f42b244d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8eb39e-23a4-40c6-8732-a40b79cf0868]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9df8d-8c04-477a-8a1b-ea0c85f3f3d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]
Jul 27 16:54:58 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d9862e-9421-4802-a762-3bb91dee828b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[66769e66-0660-46d6-bb3e-91a519ded251]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:58 user nova-compute[71026]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:54:58 user nova-compute[71026]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:54:58 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24902996-26e6-48df-9f34-13996a611489]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updated VIF entry in instance network info cache for port ac310bea-ea42-4e3b-9d1f-a6cb0602a383. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating instance_info_cache with network_info: [{"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:54:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b33857be-1d48-4cae-94fe-38b9b0c37bbb req-789d6344-e4b8-43d4-8e89-272d594d75c4 service nova] Releasing lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 84e41b88-163b-46c2-8b8b-226afc0b3e1a due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476899.180993, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:54:59 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Resumed (Lifecycle Event)
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b77951f0-6b86-4cb5-b1cc-7c4155c7b8b7 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:54:59 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476899.187892, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:54:59 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Started (Lifecycle Event)
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:54:59 user nova-compute[71026]: WARNING nova.compute.manager [req-8e972502-e8fd-433a-908f-c58ea8a0f075 req-99c828eb-970b-4124-8d68-6bf2b5eb1706 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state rescued and task_state None.
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26337313166353132', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337313166353132', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174171676',display_name='tempest-TestVolumeBootPattern-server-174171676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174171676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ummybkne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:54:51Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=8047b284-421c-40fd-804a-fcbe6eabf72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid 8047b284-421c-40fd-804a-fcbe6eabf72f {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:54:59 user nova-compute[71026]:   <uuid>8047b284-421c-40fd-804a-fcbe6eabf72f</uuid>
Jul 27 16:54:59 user nova-compute[71026]:   <name>instance-0000001f</name>
Jul 27 16:54:59 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:54:59 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:54:59 user nova-compute[71026]:   <metadata>
Jul 27 16:54:59 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:54:59 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:54:59 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-server-174171676</nova:name>
Jul 27 16:54:59 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:54:58</nova:creationTime>
Jul 27 16:54:59 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:54:59 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:54:59 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:54:59 user nova-compute[71026]:       <nova:owner>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:54:59 user nova-compute[71026]:       </nova:owner>
Jul 27 16:54:59 user nova-compute[71026]:       <nova:ports>
Jul 27 16:54:59 user nova-compute[71026]:         <nova:port uuid="fc94fb78-23da-4c3d-b67a-2253c062a00b">
Jul 27 16:54:59 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:54:59 user nova-compute[71026]:         </nova:port>
Jul 27 16:54:59 user nova-compute[71026]:       </nova:ports>
Jul 27 16:54:59 user nova-compute[71026]:     </nova:instance>
Jul 27 16:54:59 user nova-compute[71026]:   </metadata>
Jul 27 16:54:59 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:54:59 user nova-compute[71026]:     <system>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="serial">8047b284-421c-40fd-804a-fcbe6eabf72f</entry>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="uuid">8047b284-421c-40fd-804a-fcbe6eabf72f</entry>
Jul 27 16:54:59 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:54:59 user nova-compute[71026]:     </system>
Jul 27 16:54:59 user nova-compute[71026]:   </sysinfo>
Jul 27 16:54:59 user nova-compute[71026]:   <os>
Jul 27 16:54:59 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:54:59 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:54:59 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:54:59 user nova-compute[71026]:   </os>
Jul 27 16:54:59 user nova-compute[71026]:   <features>
Jul 27 16:54:59 user nova-compute[71026]:     <acpi/>
Jul 27 16:54:59 user nova-compute[71026]:     <apic/>
Jul 27 16:54:59 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:54:59 user nova-compute[71026]:   </features>
Jul 27 16:54:59 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:54:59 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:54:59 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:54:59 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:54:59 user nova-compute[71026]:   </clock>
Jul 27 16:54:59 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:54:59 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:54:59 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:54:59 user nova-compute[71026]:   </cpu>
Jul 27 16:54:59 user nova-compute[71026]:   <devices>
Jul 27 16:54:59 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:54:59 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:54:59 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:54:59 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:54:59 user nova-compute[71026]:       <serial>00cf60fe-05fc-4be0-9628-ed934f1ab1ea</serial>
Jul 27 16:54:59 user nova-compute[71026]:     </disk>
Jul 27 16:54:59 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:54:59 user nova-compute[71026]:       <mac address="fa:16:3e:ef:8e:16"/>
Jul 27 16:54:59 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:59 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:54:59 user nova-compute[71026]:       <target dev="tapfc94fb78-23"/>
Jul 27 16:54:59 user nova-compute[71026]:     </interface>
Jul 27 16:54:59 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:54:59 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/8047b284-421c-40fd-804a-fcbe6eabf72f/console.log" append="off"/>
Jul 27 16:54:59 user nova-compute[71026]:     </serial>
Jul 27 16:54:59 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:54:59 user nova-compute[71026]:     <video>
Jul 27 16:54:59 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:54:59 user nova-compute[71026]:     </video>
Jul 27 16:54:59 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:54:59 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:54:59 user nova-compute[71026]:     </rng>
Jul 27 16:54:59 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:54:59 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:54:59 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:54:59 user nova-compute[71026]:     </memballoon>
Jul 27 16:54:59 user nova-compute[71026]:   </devices>
Jul 27 16:54:59 user nova-compute[71026]: </domain>
Jul 27 16:54:59 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174171676',display_name='tempest-TestVolumeBootPattern-server-174171676',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174171676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ummybkne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:54:51Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=8047b284-421c-40fd-804a-fcbe6eabf72f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG os_vif [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc94fb78-23, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc94fb78-23, col_values=(('external_ids', {'iface-id': 'fc94fb78-23da-4c3d-b67a-2253c062a00b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:8e:16', 'vm-uuid': '8047b284-421c-40fd-804a-fcbe6eabf72f'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:54:59 user nova-compute[71026]: INFO os_vif [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23')
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:54:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:ef:8e:16, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:55:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] No waiting events found dispatching network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:01 user nova-compute[71026]: WARNING nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received unexpected event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 for instance with vm_state building and task_state spawning.
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] No waiting events found dispatching network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:01 user nova-compute[71026]: WARNING nova.compute.manager [req-fe5aeb39-ca90-4342-a8ab-f1491fa18163 req-69275e47-46ef-4f5a-8f18-d80011d8822b service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received unexpected event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 for instance with vm_state building and task_state spawning.
Jul 27 16:55:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] No waiting events found dispatching network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:01 user nova-compute[71026]: WARNING nova.compute.manager [req-12a03571-f93b-429f-aa39-eb0cfe2aae20 req-28738580-32f9-4d32-a63c-f74f2492c49f service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received unexpected event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b for instance with vm_state building and task_state spawning.
Jul 27 16:55:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476903.3291469, 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] VM Resumed (Lifecycle Event)
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Instance spawned successfully.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476903.330954, 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] VM Started (Lifecycle Event)
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Took 7.84 seconds to spawn the instance on the hypervisor.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Took 8.58 seconds to build instance.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-63132faa-f07e-41f2-a6fe-5f4343b2a6be tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.736s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] No waiting events found dispatching network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:03 user nova-compute[71026]: WARNING nova.compute.manager [req-91656d5e-280a-46b3-a83e-c548513ecf5f req-870f0139-70ea-4d37-8d6a-96cb015bff95 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received unexpected event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b for instance with vm_state building and task_state spawning.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476903.8145707, 8047b284-421c-40fd-804a-fcbe6eabf72f => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] VM Resumed (Lifecycle Event)
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Instance spawned successfully.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476903.8168166, 8047b284-421c-40fd-804a-fcbe6eabf72f => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] VM Started (Lifecycle Event)
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:03 user nova-compute[71026]: INFO nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Took 5.62 seconds to spawn the instance on the hypervisor.
Jul 27 16:55:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:04 user nova-compute[71026]: INFO nova.compute.manager [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Took 13.98 seconds to build instance.
Jul 27 16:55:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5b9b6208-a4c6-4490-9b3c-180a85cafa18 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.079s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:55:10 user nova-compute[71026]: INFO nova.compute.claims [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Claim successful on node user
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:55:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.policy [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d174521a64249cca028d0420c4ddf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63abb5340f1b41f0be26171843ffcff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:55:11 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Creating image(s)
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "/opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "/opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "/opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk 1073741824" returned: 0 in 0.051s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Successfully created port: 7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Cannot resize image /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'migration_context' on Instance uuid 70ae1748-68f6-4545-a4e6-ccf3de094721 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Ensure instance console log exists: /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Successfully updated port: 7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquired lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-changed-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Refreshing instance network info cache due to event network-changed-7672750b-e3ca-4e2d-9f22-274eeb8603fb. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] Acquiring lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:55:12 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Updating instance_info_cache with network_info: [{"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Releasing lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Instance network_info: |[{"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] Acquired lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Refreshing network info cache for port 7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Start _get_guest_xml network_info=[{"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:55:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:55:13 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369396674',display_name='tempest-VolumesActionsTest-instance-369396674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369396674',id=33,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-e50ow40p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:55:11Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=70ae1748-68f6-4545-a4e6-ccf3de094721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'pci_devices' on Instance uuid 70ae1748-68f6-4545-a4e6-ccf3de094721 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:55:13 user nova-compute[71026]:   <uuid>70ae1748-68f6-4545-a4e6-ccf3de094721</uuid>
Jul 27 16:55:13 user nova-compute[71026]:   <name>instance-00000021</name>
Jul 27 16:55:13 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:55:13 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:55:13 user nova-compute[71026]:   <metadata>
Jul 27 16:55:13 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:55:13 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:name>tempest-VolumesActionsTest-instance-369396674</nova:name>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:55:13</nova:creationTime>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:55:13 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:55:13 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:owner>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:user uuid="3d174521a64249cca028d0420c4ddf96">tempest-VolumesActionsTest-837956822-project-member</nova:user>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:project uuid="63abb5340f1b41f0be26171843ffcff5">tempest-VolumesActionsTest-837956822</nova:project>
Jul 27 16:55:13 user nova-compute[71026]:       </nova:owner>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:55:13 user nova-compute[71026]:       <nova:ports>
Jul 27 16:55:13 user nova-compute[71026]:         <nova:port uuid="7672750b-e3ca-4e2d-9f22-274eeb8603fb">
Jul 27 16:55:13 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 16:55:13 user nova-compute[71026]:         </nova:port>
Jul 27 16:55:13 user nova-compute[71026]:       </nova:ports>
Jul 27 16:55:13 user nova-compute[71026]:     </nova:instance>
Jul 27 16:55:13 user nova-compute[71026]:   </metadata>
Jul 27 16:55:13 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:55:13 user nova-compute[71026]:     <system>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="serial">70ae1748-68f6-4545-a4e6-ccf3de094721</entry>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="uuid">70ae1748-68f6-4545-a4e6-ccf3de094721</entry>
Jul 27 16:55:13 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:55:13 user nova-compute[71026]:     </system>
Jul 27 16:55:13 user nova-compute[71026]:   </sysinfo>
Jul 27 16:55:13 user nova-compute[71026]:   <os>
Jul 27 16:55:13 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:55:13 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:55:13 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:55:13 user nova-compute[71026]:   </os>
Jul 27 16:55:13 user nova-compute[71026]:   <features>
Jul 27 16:55:13 user nova-compute[71026]:     <acpi/>
Jul 27 16:55:13 user nova-compute[71026]:     <apic/>
Jul 27 16:55:13 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:55:13 user nova-compute[71026]:   </features>
Jul 27 16:55:13 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:55:13 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:55:13 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:55:13 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:55:13 user nova-compute[71026]:   </clock>
Jul 27 16:55:13 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:55:13 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:55:13 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:55:13 user nova-compute[71026]:   </cpu>
Jul 27 16:55:13 user nova-compute[71026]:   <devices>
Jul 27 16:55:13 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:55:13 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:55:13 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk"/>
Jul 27 16:55:13 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:55:13 user nova-compute[71026]:     </disk>
Jul 27 16:55:13 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:55:13 user nova-compute[71026]:       <mac address="fa:16:3e:2f:e7:03"/>
Jul 27 16:55:13 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:55:13 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:55:13 user nova-compute[71026]:       <target dev="tap7672750b-e3"/>
Jul 27 16:55:13 user nova-compute[71026]:     </interface>
Jul 27 16:55:13 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:55:13 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/console.log" append="off"/>
Jul 27 16:55:13 user nova-compute[71026]:     </serial>
Jul 27 16:55:13 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:55:13 user nova-compute[71026]:     <video>
Jul 27 16:55:13 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:55:13 user nova-compute[71026]:     </video>
Jul 27 16:55:13 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:55:13 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:55:13 user nova-compute[71026]:     </rng>
Jul 27 16:55:13 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:55:13 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:55:13 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:55:13 user nova-compute[71026]:     </memballoon>
Jul 27 16:55:13 user nova-compute[71026]:   </devices>
Jul 27 16:55:13 user nova-compute[71026]: </domain>
Jul 27 16:55:13 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369396674',display_name='tempest-VolumesActionsTest-instance-369396674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369396674',id=33,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-e50ow40p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:55:11Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=70ae1748-68f6-4545-a4e6-ccf3de094721,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG os_vif [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7672750b-e3, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7672750b-e3, col_values=(('external_ids', {'iface-id': '7672750b-e3ca-4e2d-9f22-274eeb8603fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:e7:03', 'vm-uuid': '70ae1748-68f6-4545-a4e6-ccf3de094721'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:13 user nova-compute[71026]: INFO os_vif [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3')
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] No VIF found with MAC fa:16:3e:2f:e7:03, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Updated VIF entry in instance network info cache for port 7672750b-e3ca-4e2d-9f22-274eeb8603fb. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG nova.network.neutron [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Updating instance_info_cache with network_info: [{"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:55:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-32a16bec-d863-40a9-a8ed-1f8cc29b3de3 req-f76dab0a-31fe-441a-9117-c17bdfda727e service nova] Releasing lock "refresh_cache-70ae1748-68f6-4545-a4e6-ccf3de094721" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] No waiting events found dispatching network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:14 user nova-compute[71026]: WARNING nova.compute.manager [req-309863e9-7601-487b-8099-fe55dd9dc4bc req-fa802bd4-5ed7-4794-ac0d-e7b44213ff26 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received unexpected event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb for instance with vm_state building and task_state spawning.
Jul 27 16:55:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476916.8787434, 70ae1748-68f6-4545-a4e6-ccf3de094721 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:16 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] VM Resumed (Lifecycle Event)
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:55:16 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Instance spawned successfully.
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:55:16 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476916.8841891, 70ae1748-68f6-4545-a4e6-ccf3de094721 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:16 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] VM Started (Lifecycle Event)
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] No waiting events found dispatching network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:16 user nova-compute[71026]: WARNING nova.compute.manager [req-70b63352-7935-4151-b4e4-80822e040d53 req-a9673241-7636-4c04-976f-e9a95179921a service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received unexpected event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb for instance with vm_state building and task_state spawning.
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:55:17 user nova-compute[71026]: INFO nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Took 5.73 seconds to spawn the instance on the hypervisor.
Jul 27 16:55:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:17 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:55:17 user nova-compute[71026]: INFO nova.compute.manager [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Took 6.39 seconds to build instance.
Jul 27 16:55:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dab3dfae-435e-4781-8a72-706f47951f7b tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:29 user nova-compute[71026]: INFO nova.compute.manager [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Terminating instance
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-4b5330e1-6619-4a3e-9d48-2dd625dc91f3 req-7d5af887-2566-4167-a507-194d03387e53 service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-unplugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Instance destroyed successfully.
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.objects.instance [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lazy-loading 'resources' on Instance uuid 3037d3ff-300a-42b0-a022-3aa1e9df52a6 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-230134682',display_name='tempest-ServerActionsTestOtherA-server-1391208785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-230134682',id=17,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0xu7HNTsmTA0Exm9u7pbGyM1ltTu3+70cfpoG0Rvf6I1vKAaVmii/8suoNd1EqdxClsOcBrTBKnt6YPt0RsT7xs2LmhBH9IWSM5bc8czvvbb6cFemNmdTv2lMf1kDgLw==',key_name='tempest-keypair-729751377',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:43:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40b15450553d464cbeac2d3d910e8043',ramdisk_id='',reservation_id='r-i7jxcbie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1832986311',owner_user_name='tempest-ServerActionsTestOtherA-1832986311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e106be16f498443091e8ae9f95311beb',uuid=3037d3ff-300a-42b0-a022-3aa1e9df52a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converting VIF {"id": "edd92f92-526b-4110-9219-7dce34224f86", "address": "fa:16:3e:7c:3e:82", "network": {"id": "79266567-fd75-46de-8da6-ffe55aaa4b44", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-55173722-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40b15450553d464cbeac2d3d910e8043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd92f92-52", "ovs_interfaceid": "edd92f92-526b-4110-9219-7dce34224f86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG os_vif [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd92f92-52, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:55:29 user nova-compute[71026]: INFO os_vif [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:3e:82,bridge_name='br-int',has_traffic_filtering=True,id=edd92f92-526b-4110-9219-7dce34224f86,network=Network(79266567-fd75-46de-8da6-ffe55aaa4b44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd92f92-52')
Jul 27 16:55:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Deleting instance files /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6_del
Jul 27 16:55:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Deletion of /opt/stack/data/nova/instances/3037d3ff-300a-42b0-a022-3aa1e9df52a6_del complete
Jul 27 16:55:30 user nova-compute[71026]: INFO nova.compute.manager [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:55:30 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Took 0.61 seconds to deallocate network for instance.
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:55:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:30 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Deleted allocations for instance 3037d3ff-300a-42b0-a022-3aa1e9df52a6
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-78f4b266-1420-4f6f-a136-5c41bd3d2fe6 tempest-ServerActionsTestOtherA-1832986311 tempest-ServerActionsTestOtherA-1832986311-project-member] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] Acquiring lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] Lock "3037d3ff-300a-42b0-a022-3aa1e9df52a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] No waiting events found dispatching network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:55:31 user nova-compute[71026]: WARNING nova.compute.manager [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received unexpected event network-vif-plugged-edd92f92-526b-4110-9219-7dce34224f86 for instance with vm_state deleted and task_state None.
Jul 27 16:55:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f69198e-40a3-495c-8400-40b3a542e02d req-13240c9c-825a-43f9-a697-8401b33add2b service nova] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Received event network-vif-deleted-edd92f92-526b-4110-9219-7dce34224f86 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:55:32 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:55:32 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.560760498046875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8047b284-421c-40fd-804a-fcbe6eabf72f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 70ae1748-68f6-4545-a4e6-ccf3de094721 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:55:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:55:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:55:33 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:55:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:55:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:55:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:44 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690476929.9003127, 3037d3ff-300a-42b0-a022-3aa1e9df52a6 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:55:44 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] VM Stopped (Lifecycle Event)
Jul 27 16:55:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2d3e9b19-ef12-4d94-ade8-51ed5f83be3a None None] [instance: 3037d3ff-300a-42b0-a022-3aa1e9df52a6] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:55:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 16:55:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:55:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 16:55:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:55:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:55:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:56:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:56:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:56:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:56:31 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:56:31 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8134MB free_disk=25.549495697021484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 8047b284-421c-40fd-804a-fcbe6eabf72f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 70ae1748-68f6-4545-a4e6-ccf3de094721 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:56:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:56:33 user nova-compute[71026]: INFO nova.compute.claims [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Claim successful on node user
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:56:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:56:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.policy [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e60e4b7b164fc19a1d932799eca227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebe60ded919474b85143cbe6d607ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:56:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Creating image(s)
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk 1073741824" returned: 0 in 0.060s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Successfully created port: b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Cannot resize image /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'migration_context' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Ensure instance console log exists: /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Successfully updated port: b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing instance network info cache due to event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance network_info: |[{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.network.neutron [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start _get_guest_xml network_info=[{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:56:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:56:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:56:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKspkk7w+FwtZQTLfjMBa/GZrR8Qmlkilyj67/n7Sa0+jnV9l7wAyDo6tff0DUzGromfCPkof+uL8AP61i11zb78DnUkWhykQRsL0iLbfHgX6TDXpnNF8Nz2ZfnGxIO+ZA==',key_name='tempest-keypair-539704832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_devices' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:56:36 user nova-compute[71026]:   <uuid>e5aa2385-ce14-4055-9aa4-666bbeb33dac</uuid>
Jul 27 16:56:36 user nova-compute[71026]:   <name>instance-00000022</name>
Jul 27 16:56:36 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:56:36 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:56:36 user nova-compute[71026]:   <metadata>
Jul 27 16:56:36 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:56:36 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-490787159</nova:name>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:56:35</nova:creationTime>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:56:36 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:56:36 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:owner>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:user uuid="62e60e4b7b164fc19a1d932799eca227">tempest-AttachVolumeShelveTestJSON-576960083-project-member</nova:user>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:project uuid="bebe60ded919474b85143cbe6d607ba5">tempest-AttachVolumeShelveTestJSON-576960083</nova:project>
Jul 27 16:56:36 user nova-compute[71026]:       </nova:owner>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:56:36 user nova-compute[71026]:       <nova:ports>
Jul 27 16:56:36 user nova-compute[71026]:         <nova:port uuid="b22bca0c-a4ec-4455-98b9-a5cac7e2efff">
Jul 27 16:56:36 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:56:36 user nova-compute[71026]:         </nova:port>
Jul 27 16:56:36 user nova-compute[71026]:       </nova:ports>
Jul 27 16:56:36 user nova-compute[71026]:     </nova:instance>
Jul 27 16:56:36 user nova-compute[71026]:   </metadata>
Jul 27 16:56:36 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:56:36 user nova-compute[71026]:     <system>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="serial">e5aa2385-ce14-4055-9aa4-666bbeb33dac</entry>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="uuid">e5aa2385-ce14-4055-9aa4-666bbeb33dac</entry>
Jul 27 16:56:36 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:56:36 user nova-compute[71026]:     </system>
Jul 27 16:56:36 user nova-compute[71026]:   </sysinfo>
Jul 27 16:56:36 user nova-compute[71026]:   <os>
Jul 27 16:56:36 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:56:36 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:56:36 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:56:36 user nova-compute[71026]:   </os>
Jul 27 16:56:36 user nova-compute[71026]:   <features>
Jul 27 16:56:36 user nova-compute[71026]:     <acpi/>
Jul 27 16:56:36 user nova-compute[71026]:     <apic/>
Jul 27 16:56:36 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:56:36 user nova-compute[71026]:   </features>
Jul 27 16:56:36 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:56:36 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:56:36 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:56:36 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:56:36 user nova-compute[71026]:   </clock>
Jul 27 16:56:36 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:56:36 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:56:36 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:56:36 user nova-compute[71026]:   </cpu>
Jul 27 16:56:36 user nova-compute[71026]:   <devices>
Jul 27 16:56:36 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:56:36 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:56:36 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk"/>
Jul 27 16:56:36 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:56:36 user nova-compute[71026]:     </disk>
Jul 27 16:56:36 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:56:36 user nova-compute[71026]:       <mac address="fa:16:3e:1e:a4:02"/>
Jul 27 16:56:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:56:36 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:56:36 user nova-compute[71026]:       <target dev="tapb22bca0c-a4"/>
Jul 27 16:56:36 user nova-compute[71026]:     </interface>
Jul 27 16:56:36 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:56:36 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/console.log" append="off"/>
Jul 27 16:56:36 user nova-compute[71026]:     </serial>
Jul 27 16:56:36 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:56:36 user nova-compute[71026]:     <video>
Jul 27 16:56:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:56:36 user nova-compute[71026]:     </video>
Jul 27 16:56:36 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:56:36 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:56:36 user nova-compute[71026]:     </rng>
Jul 27 16:56:36 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:56:36 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:56:36 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:56:36 user nova-compute[71026]:     </memballoon>
Jul 27 16:56:36 user nova-compute[71026]:   </devices>
Jul 27 16:56:36 user nova-compute[71026]: </domain>
Jul 27 16:56:36 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKspkk7w+FwtZQTLfjMBa/GZrR8Qmlkilyj67/n7Sa0+jnV9l7wAyDo6tff0DUzGromfCPkof+uL8AP61i11zb78DnUkWhykQRsL0iLbfHgX6TDXpnNF8Nz2ZfnGxIO+ZA==',key_name='tempest-keypair-539704832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG os_vif [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22bca0c-a4, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb22bca0c-a4, col_values=(('external_ids', {'iface-id': 'b22bca0c-a4ec-4455-98b9-a5cac7e2efff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a4:02', 'vm-uuid': 'e5aa2385-ce14-4055-9aa4-666bbeb33dac'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:36 user nova-compute[71026]: INFO os_vif [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4')
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No VIF found with MAC fa:16:3e:1e:a4:02, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updated VIF entry in instance network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8db9e9ba-d535-49ee-acc8-38cfdfff9549 req-953f4d10-7cf5-49e6-9860-27230a6f6965 service nova] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:37 user nova-compute[71026]: WARNING nova.compute.manager [req-7e16d4cd-f429-4830-9472-c392925b6f22 req-b649980e-e674-48c1-8ad9-f4c563e6b67b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state building and task_state spawning.
Jul 27 16:56:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476999.719934, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Resumed (Lifecycle Event)
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance spawned successfully.
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:39 user nova-compute[71026]: WARNING nova.compute.manager [req-05b4b0d7-89d6-4813-b094-237c9b2a6893 req-f6c22829-23ab-4dc2-9279-3dfc31f5456f service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state building and task_state spawning.
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690476999.7216668, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Started (Lifecycle Event)
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Took 5.68 seconds to spawn the instance on the hypervisor.
Jul 27 16:56:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:39 user nova-compute[71026]: INFO nova.compute.manager [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Took 6.44 seconds to build instance.
Jul 27 16:56:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dafa0162-f7de-476e-8168-bd29cdf7f0b6 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Unrescuing
Jul 27 16:56:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:56:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:56:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:56:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:56:42 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'flavor' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-changed-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Refreshing instance network info cache due to event network-changed-fc94fb78-23da-4c3d-b67a-2253c062a00b. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] Acquiring lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] Acquired lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Refreshing network info cache for port fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:43 user nova-compute[71026]: INFO nova.compute.manager [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Terminating instance
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updated VIF entry in instance network info cache for port fc94fb78-23da-4c3d-b67a-2253c062a00b. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updating instance_info_cache with network_info: [{"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance destroyed successfully.
Jul 27 16:56:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f5fb3c10-556a-40a2-b36a-d86fd175baec req-7bb7e1a7-b918-4ea5-895e-6ae2a973d9ae service nova] Releasing lock "refresh_cache-8047b284-421c-40fd-804a-fcbe6eabf72f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-unplugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] No waiting events found dispatching network-vif-unplugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad638443-85d5-46a5-b42a-8722a4f84a57 req-e08a1fa3-630d-4f7d-8163-7254ae7cacd5 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-unplugged-fc94fb78-23da-4c3d-b67a-2253c062a00b for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:56:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Instance destroyed successfully.
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid 8047b284-421c-40fd-804a-fcbe6eabf72f {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-174171676',display_name='tempest-TestVolumeBootPattern-server-174171676',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-174171676',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-ummybkne',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:55:04Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=8047b284-421c-40fd-804a-fcbe6eabf72f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "address": "fa:16:3e:ef:8e:16", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc94fb78-23", "ovs_interfaceid": "fc94fb78-23da-4c3d-b67a-2253c062a00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_vif [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc94fb78-23, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: INFO os_vif [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:8e:16,bridge_name='br-int',has_traffic_filtering=True,id=fc94fb78-23da-4c3d-b67a-2253c062a00b,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc94fb78-23')
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:56:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[087567f9-cd7c-4c50-bc8c-e0ab4d24a9ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:56:45 user nova-compute[71026]: No targets found.
Jul 27 16:56:45 user nova-compute[71026]: iSNS:
Jul 27 16:56:45 user nova-compute[71026]: No targets found.
Jul 27 16:56:45 user nova-compute[71026]: STATIC:
Jul 27 16:56:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea
Jul 27 16:56:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:56:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:56:45 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:56:45 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:56:45 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:56:45 user nova-compute[71026]: FIRMWARE:
Jul 27 16:56:45 user nova-compute[71026]: No targets found.
Jul 27 16:56:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:56:45 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:56:45 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b8aaef-d3b1-4164-ada5-e6f877b3050e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1abb2e-505a-45c0-b520-9121a609a02d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:45 user nova-compute[71026]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:56:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:45 user nova-compute[71026]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:56:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308868e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc2d74-4c4e-4080-81ec-f824215ad8d8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef56fb-80bb-47ae-8ac5-b8b63410e952]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db1477e-dfa5-4116-af5c-81bb9642f637]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c896802-01d6-406b-8055-7499bdbd732a]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:45 user nova-compute[71026]: WARNING nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:45 user nova-compute[71026]: WARNING nova.compute.manager [req-b4ef2954-f05a-4664-980b-e691929d1c0e req-5af0c12c-ff43-4ad2-87c6-ba5ec191a6cf service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14abbb44-4658-4656-8712-a2ac43f3fa25]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e799493-bedd-480e-acee-e0113905af8e]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]
Jul 27 16:56:45 user nova-compute[71026]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.
Jul 27 16:56:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faa2c75-82c4-4697-8c82-7c785ea6bb37]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (357ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:56:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Deleting instance files /opt/stack/data/nova/instances/8047b284-421c-40fd-804a-fcbe6eabf72f_del
Jul 27 16:56:45 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Deletion of /opt/stack/data/nova/instances/8047b284-421c-40fd-804a-fcbe6eabf72f_del complete
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:45 user nova-compute[71026]: INFO nova.compute.manager [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Took 1.83 seconds to destroy the instance on the hypervisor.
Jul 27 16:56:45 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:56:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] Acquiring lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] No waiting events found dispatching network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:46 user nova-compute[71026]: WARNING nova.compute.manager [req-5381498b-a670-4f1a-963d-07de36d813e2 req-a259d28b-0cf0-434f-bbe9-59a06bb3beee service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received unexpected event network-vif-plugged-fc94fb78-23da-4c3d-b67a-2253c062a00b for instance with vm_state active and task_state deleting.
Jul 27 16:56:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-changed-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Refreshing instance network info cache due to event network-changed-ac310bea-ea42-4e3b-9d1f-a6cb0602a383. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] Acquiring lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] Acquired lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:56:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Refreshing network info cache for port ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updated VIF entry in instance network info cache for port ac310bea-ea42-4e3b-9d1f-a6cb0602a383. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating instance_info_cache with network_info: [{"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:56:47 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Took 1.52 seconds to deallocate network for instance.
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d3bb228-2303-467d-867e-97e5d43db93e req-2fd4c773-c4ec-4430-b5e9-f919128ed5cb service nova] Releasing lock "refresh_cache-9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:47 user nova-compute[71026]: WARNING nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:56:47 user nova-compute[71026]: WARNING nova.compute.manager [req-5e3e3f18-1b07-4348-940f-8fbae695a5e4 req-9e0b74f5-c720-41e4-a23e-cffe3c0f03b1 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state rescued and task_state unrescuing.
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 84e41b88-163b-46c2-8b8b-226afc0b3e1a due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477007.7585611, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:56:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Resumed (Lifecycle Event)
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e2e8fb23-73ee-4677-a025-640680c230e0 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:56:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477007.7594817, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:56:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Started (Lifecycle Event)
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:56:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:56:47 user nova-compute[71026]: INFO nova.compute.manager [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Took 0.87 seconds to detach 1 volumes for instance.
Jul 27 16:56:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:48 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:56:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-51231d74-9106-451e-b96d-3b1c7f6fe8b0 req-89400c3b-e60f-4861-b791-569ebdd66857 service nova] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Received event network-vif-deleted-fc94fb78-23da-4c3d-b67a-2253c062a00b {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:56:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:56:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:48 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance 8047b284-421c-40fd-804a-fcbe6eabf72f
Jul 27 16:56:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7146f3a3-4ba8-48c4-a71c-20ec8937b1ae tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "8047b284-421c-40fd-804a-fcbe6eabf72f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.702s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:49 user nova-compute[71026]: DEBUG nova.objects.instance [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:56:50 user nova-compute[71026]: INFO nova.compute.manager [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attaching volume d69275e5-19ed-45c1-aaff-ef91edf9ca82 to /dev/vdb
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6183a-a30f-4ff4-8d8d-3d84251bb534]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd22f95a-32bc-4065-bd3a-a72800e4f700]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eab1d24-7ba4-4394-9f21-8ffaa1289363]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855a9d9-178e-4f86-bf38-164e5a9b3a8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:56:50 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:56:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14042f92-2ac7-4e03-a1c7-22452efbb77d]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG os_brick.utils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:56:50 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating existing volume attachment record: 8cb71a8e-f21a-4f46-8cbb-4fbbc576c47a {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:56:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHxPnAbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:56:57 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:56:57 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:56:57 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcbce47-7d43-4291-9327-73e23e9dd1d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:56:57 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[981aafe0-ba98-4dca-b30c-8bc6197e62a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82] added
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e9d257-1ea7-4702-9255-1468482fd5e4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[970bf633-c0d5-41d4-b230-f071cb5d478c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHxPnAbF {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHxPnAbF" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dd3e44-2770-4c15-aa7b-50e3d5520fde]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHxPnAbF'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87638f4-0acd-4b1b-81c4-2b2befd7ed64]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d165fd-0a4f-460b-a593-959bc14ff959]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1181b288-ff4b-44ad-8722-0af24bb8cbe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260]
Jul 27 16:56:57 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260] successful.
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e351f942-ab0c-465e-88ac-b56038d487a6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f070e9-81bc-4b2a-80c8-671ae752771b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:57 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:56:57 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:56:57 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe2affe-d84d-456c-b19f-3ff78c8d6157]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:56:57 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHxPnAbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26666366235356439', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666366235356439', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:56:58 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:56:58 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:56:58 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:56:58 user nova-compute[71026]:   <serial>d69275e5-19ed-45c1-aaff-ef91edf9ca82</serial>
Jul 27 16:56:58 user nova-compute[71026]: </disk>
Jul 27 16:56:58 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No VIF found with MAC fa:16:3e:17:fe:ff, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:56:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-852f60bb-b9b4-4079-ba7e-693b606405b2 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.716s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:56:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:00 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477005.0743825, 8047b284-421c-40fd-804a-fcbe6eabf72f => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:00 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] VM Stopped (Lifecycle Event)
Jul 27 16:57:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3fc62a2d-e8cd-495e-992e-54bdb1e3604a None None] [instance: 8047b284-421c-40fd-804a-fcbe6eabf72f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:01 user nova-compute[71026]: INFO nova.compute.manager [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Terminating instance
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-unplugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] No waiting events found dispatching network-vif-unplugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f63be3d-4c97-413b-8fa1-09f79b281c8d req-a866e4b0-aedb-47df-8e80-29e26b3f3d73 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-unplugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:57:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Instance destroyed successfully.
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'resources' on Instance uuid 70ae1748-68f6-4545-a4e6-ccf3de094721 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:55:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-369396674',display_name='tempest-VolumesActionsTest-instance-369396674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-369396674',id=33,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:55:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-e50ow40p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:55:17Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=70ae1748-68f6-4545-a4e6-ccf3de094721,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "address": "fa:16:3e:2f:e7:03", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7672750b-e3", "ovs_interfaceid": "7672750b-e3ca-4e2d-9f22-274eeb8603fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG os_vif [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7672750b-e3, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:01 user nova-compute[71026]: INFO os_vif [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:e7:03,bridge_name='br-int',has_traffic_filtering=True,id=7672750b-e3ca-4e2d-9f22-274eeb8603fb,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7672750b-e3')
Jul 27 16:57:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Deleting instance files /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721_del
Jul 27 16:57:01 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Deletion of /opt/stack/data/nova/instances/70ae1748-68f6-4545-a4e6-ccf3de094721_del complete
Jul 27 16:57:01 user nova-compute[71026]: INFO nova.compute.manager [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 27 16:57:01 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:57:01 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:57:02 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:02 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Took 0.58 seconds to deallocate network for instance.
Jul 27 16:57:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:57:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:57:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:02 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Deleted allocations for instance 70ae1748-68f6-4545-a4e6-ccf3de094721
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-cab60d05-4a24-48a8-9e7d-25cb2a8208af tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.732s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] Acquiring lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] Lock "70ae1748-68f6-4545-a4e6-ccf3de094721-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] No waiting events found dispatching network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:03 user nova-compute[71026]: WARNING nova.compute.manager [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received unexpected event network-vif-plugged-7672750b-e3ca-4e2d-9f22-274eeb8603fb for instance with vm_state deleted and task_state None.
Jul 27 16:57:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-80dc813e-0979-4cc9-8bbc-1fc7fe13dd82 req-571c3f0b-0eb2-4319-93c7-caf5801956e3 service nova] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Received event network-vif-deleted-7672750b-e3ca-4e2d-9f22-274eeb8603fb {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:03 user nova-compute[71026]: INFO nova.compute.manager [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attaching volume 8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 to /dev/vdc
Jul 27 16:57:03 user nova-compute[71026]: DEBUG os_brick.utils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0908c188-3a52-402d-a78f-c30a51c19e78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8200d04b-9f30-4cf8-92eb-c01e10353615]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af24a9a-8b91-498f-a9f9-9cb2473b1ff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8012552e-f091-4d6d-805b-c650aba80019]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:03 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:57:04 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:57:04 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0ba63a-aed3-4442-8cce-5fbd37b1cdc6]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG os_brick.utils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating existing volume attachment record: 10077a42-49f8-4946-84af-8a3f6346ec94 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:57:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMRzdpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:10 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0681ce43-550f-4bfc-b52d-5baf18245175]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:57:10 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453cd7a-68ad-417b-86b1-6661979c7dea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3] added
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[15756162-36d3-40f7-988b-41ee922e9483]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3dd0d6-f532-433b-80c0-3fb34a072bfd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPMRzdpn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPMRzdpn" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e844ee-d265-4df7-bd07-a25c15943453]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPMRzdpn'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84780d75-2c05-44a9-acab-1d40c6aefdc2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ca206-af88-4233-8c07-242f0fbed416]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff03b2a-015f-4b27-912e-dc15df4afe7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260]
Jul 27 16:57:10 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260] successful.
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a947107-8db0-49cf-94be-ef25a7eb6c3e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe09dc6-5106-4b8d-9168-43e9ff632eb4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e3cda-6aa4-4b90-b257-ec0575d50e20]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:57:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMRzdpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:57:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:11 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26362373531663336', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:11 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362373531663336', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 16:57:12 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:12 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:57:12 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:57:12 user nova-compute[71026]:   <serial>8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3</serial>
Jul 27 16:57:12 user nova-compute[71026]: </disk>
Jul 27 16:57:12 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] No VIF found with MAC fa:16:3e:17:fe:ff, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:57:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-15d1a6ff-16ae-4a83-b8b6-f6f7680765ee tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.698s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:13 user nova-compute[71026]: INFO nova.compute.manager [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Detaching volume d69275e5-19ed-45c1-aaff-ef91edf9ca82
Jul 27 16:57:14 user nova-compute[71026]: INFO nova.virt.block_device [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attempting to driver detach volume d69275e5-19ed-45c1-aaff-ef91edf9ca82 from mountpoint /dev/vdb
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Attempting to detach device vdb from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:57:14 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:14 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:57:14 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:57:14 user nova-compute[71026]:   <serial>d69275e5-19ed-45c1-aaff-ef91edf9ca82</serial>
Jul 27 16:57:14 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:57:14 user nova-compute[71026]: </disk>
Jul 27 16:57:14 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:57:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdb from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the persistent domain config.
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:57:14 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:14 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 16:57:14 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 16:57:14 user nova-compute[71026]:   <serial>d69275e5-19ed-45c1-aaff-ef91edf9ca82</serial>
Jul 27 16:57:14 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 16:57:14 user nova-compute[71026]: </disk>
Jul 27 16:57:14 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477034.4989235, 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:57:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdb from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the live domain config.
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHxPnAbF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:14 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d7390-83b1-4672-9432-f40440a139c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:57:14 user nova-compute[71026]: No targets found.
Jul 27 16:57:14 user nova-compute[71026]: iSNS:
Jul 27 16:57:14 user nova-compute[71026]: No targets found.
Jul 27 16:57:14 user nova-compute[71026]: STATIC:
Jul 27 16:57:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82
Jul 27 16:57:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:57:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:57:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3
Jul 27 16:57:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:57:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:57:14 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:57:14 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:57:14 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:57:14 user nova-compute[71026]: FIRMWARE:
Jul 27 16:57:14 user nova-compute[71026]: No targets found.
Jul 27 16:57:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:57:14 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:57:14 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bdcb11-bfd2-406b-b142-cec40d9ba7ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[470faf3e-a4c4-480c-97f2-445e57fc219f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:14 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:14 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:14 user nova-compute[71026]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 (non-flash)
Jul 27 16:57:14 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30ac139ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8f8a8-aef5-4f6a-9128-37df85dadec0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2d806-b070-4ce0-b8f3-04cb00fa0652]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaa0cad-f57c-4def-8caf-d632e71d46f0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca5f533-4667-481f-b6a3-67a24ea7e84d]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ad4899-d7f4-4cae-a8f2-86bbca7ceab2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c75686-1ca1-4934-8ccf-10ba6e568321]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260]
Jul 27 16:57:14 user nova-compute[71026]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82, portal: 172.16.0.220,3260] successful.
Jul 27 16:57:14 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69275e5-19ed-45c1-aaff-ef91edf9ca82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb53086-e311-4494-a1d2-a631b00c3c9e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== disconnect_volume: return (293ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:57:15 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b88fd9d9-e9eb-48d5-bfdd-a3bb0b293ee0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.631s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:16 user nova-compute[71026]: INFO nova.compute.manager [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Detaching volume 8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3
Jul 27 16:57:16 user nova-compute[71026]: INFO nova.virt.block_device [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Attempting to driver detach volume 8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 from mountpoint /dev/vdc
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Attempting to detach device vdc from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:57:16 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:16 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:57:16 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:57:16 user nova-compute[71026]:   <serial>8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3</serial>
Jul 27 16:57:16 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:57:16 user nova-compute[71026]: </disk>
Jul 27 16:57:16 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:57:16 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdc from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the persistent domain config.
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 16:57:16 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:16 user nova-compute[71026]:   <source dev="/dev/sdd"/>
Jul 27 16:57:16 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 16:57:16 user nova-compute[71026]:   <serial>8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3</serial>
Jul 27 16:57:16 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 27 16:57:16 user nova-compute[71026]: </disk>
Jul 27 16:57:16 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477021.8352642, 70ae1748-68f6-4545-a4e6-ccf3de094721 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:16 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] VM Stopped (Lifecycle Event)
Jul 27 16:57:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ce9d2b04-bc76-409f-b239-b697113c5d24 None None] [instance: 70ae1748-68f6-4545-a4e6-ccf3de094721] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477037.1422946, 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 16:57:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully detached device vdc from instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c from the live domain config.
Jul 27 16:57:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMRzdpn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:17 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01d9f2-7fad-4e3a-a2db-acd06ac8e831]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 16:57:17 user nova-compute[71026]: No targets found.
Jul 27 16:57:17 user nova-compute[71026]: iSNS:
Jul 27 16:57:17 user nova-compute[71026]: No targets found.
Jul 27 16:57:17 user nova-compute[71026]: STATIC:
Jul 27 16:57:17 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3
Jul 27 16:57:17 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:57:17 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:57:17 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 16:57:17 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 16:57:17 user nova-compute[71026]:                 Iface Name: default
Jul 27 16:57:17 user nova-compute[71026]: FIRMWARE:
Jul 27 16:57:17 user nova-compute[71026]: No targets found.
Jul 27 16:57:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 16:57:17 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 16:57:17 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01303a04-be91-4334-83fb-bb585e0b195a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd139437-e1ec-47be-8acf-b897d0a09b10]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:17 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:17 user nova-compute[71026]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 (non-flash)
Jul 27 16:57:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a81ac3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fb5e03-f0ba-49c6-9f56-e9bd995229bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57f606-fc33-4f70-8d32-e4e860a80f0b]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17edf9c-9d2b-4437-ac1f-7894fddfb2d9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3d51f-eb1d-42fd-ac97-d3be51075bf1]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e2d5d-d222-4a65-8813-70df45086fad]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae80688-0ec4-4cef-b8d7-f9643e0c3793]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260]
Jul 27 16:57:17 user nova-compute[71026]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3, portal: 172.16.0.220,3260] successful.
Jul 27 16:57:17 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8159a3a2-77ea-4dc5-8f84-3f3e89ae32e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1b443-d899-42e7-a5bd-1579364ba348]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] <== disconnect_volume: return (294ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:17 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 16:57:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'flavor' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7021d986-213a-4d61-9f70-b4d0faada1f0 tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:19 user nova-compute[71026]: INFO nova.compute.manager [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Terminating instance
Jul 27 16:57:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-unplugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] No waiting events found dispatching network-vif-unplugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2e88b58-6faa-4e81-afe2-564e1d51fe6a req-bbd688b9-14c2-4145-ad9e-f33cc3753f05 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-unplugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Instance destroyed successfully.
Jul 27 16:57:19 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lazy-loading 'resources' on Instance uuid 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:54:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1170028898',display_name='tempest-AttachVolumeTestJSON-server-1170028898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1170028898',id=32,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4dsHA3dbCqmceWqAAHc7ZAzBQ3+0aVcL7LJjrty7C4GG4CozA/7lKVfmUKNALJzy/Q6OVXcTRY8u9676/quk8ZWa1FTfCRptRWvlf9fnb9CA7cAgHAycbzanADJV+CgA==',key_name='tempest-keypair-1488707525',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4a20fd76c514ce488f9467e5ec36012',ramdisk_id='',reservation_id='r-bln8jly4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2013998243',owner_user_name='tempest-AttachVolumeTestJSON-2013998243-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c543c6c138ad482ca985d5a756f78334',uuid=9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converting VIF {"id": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "address": "fa:16:3e:17:fe:ff", "network": {"id": "4196d6c6-3dc4-4135-9140-5024c6232aa0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-277446939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4a20fd76c514ce488f9467e5ec36012", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac310bea-ea", "ovs_interfaceid": "ac310bea-ea42-4e3b-9d1f-a6cb0602a383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG os_vif [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac310bea-ea, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:20 user nova-compute[71026]: INFO os_vif [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:fe:ff,bridge_name='br-int',has_traffic_filtering=True,id=ac310bea-ea42-4e3b-9d1f-a6cb0602a383,network=Network(4196d6c6-3dc4-4135-9140-5024c6232aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac310bea-ea')
Jul 27 16:57:20 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Deleting instance files /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c_del
Jul 27 16:57:20 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Deletion of /opt/stack/data/nova/instances/9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c_del complete
Jul 27 16:57:20 user nova-compute[71026]: INFO nova.compute.manager [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 27 16:57:20 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:57:20 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:21 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Took 1.32 seconds to deallocate network for instance.
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-db1c1e0e-8d9d-4532-978f-a58b97f2332a req-1f2d92b4-f7bf-4ba2-ba79-f1f78e1aa430 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-deleted-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] Acquiring lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] No waiting events found dispatching network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:21 user nova-compute[71026]: WARNING nova.compute.manager [req-947026a5-c4ed-4b4a-9077-2df16dcdbcd6 req-40444d7d-c616-42c1-bac9-e80495bc65f6 service nova] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Received unexpected event network-vif-plugged-ac310bea-ea42-4e3b-9d1f-a6cb0602a383 for instance with vm_state deleted and task_state None.
Jul 27 16:57:21 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Deleted allocations for instance 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c
Jul 27 16:57:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dbddf42f-c8bd-468b-9157-f51d8f39c54a tempest-AttachVolumeTestJSON-2013998243 tempest-AttachVolumeTestJSON-2013998243-project-member] Lock "9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.550s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:24 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:33 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8444MB free_disk=25.57479476928711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e5aa2385-ce14-4055-9aa4-666bbeb33dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:57:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:34 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477039.9908583, 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:34 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] VM Stopped (Lifecycle Event)
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-a04198ab-c51e-473c-a469-656a1383c190 None None] [instance: 9bf27be3-33c5-4a95-b405-b8fe1bd9ae8c] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:57:35 user nova-compute[71026]: INFO nova.compute.claims [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Claim successful on node user
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:57:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:57:35 user nova-compute[71026]: INFO nova.virt.block_device [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Booting with volume 00cf60fe-05fc-4be0-9628-ed934f1ab1ea at /dev/vda
Jul 27 16:57:35 user nova-compute[71026]: DEBUG nova.policy [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG os_brick.utils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e671499-f603-4336-b7d5-27eb7bdbc6ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[864c43d0-501f-4bec-b2d0-9e2a42750ef4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[417e0714-1c9c-4f05-9c7c-61699e3a4ef6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b48547-55de-40b2-87f5-4e6d8a845f82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:57:36 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a99fa7-86f3-49cb-b590-310666076160]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG os_brick.utils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating existing volume attachment record: 0fd8f9cb-4313-458d-b9a0-d8402adea087 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Successfully created port: f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Successfully updated port: f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing instance network info cache due to event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] Acquiring lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Instance network_info: |[{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] Acquired lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:57:37 user nova-compute[71026]: DEBUG nova.network.neutron [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:57:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updated VIF entry in instance network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:57:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2d98dcae-36db-4634-b13d-ea3356af0896 req-658f8e74-64a5-4789-8ba3-420269ae671c service nova] Releasing lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:57:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:57:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Creating image(s)
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Ensure instance console log exists: /opt/stack/data/nova/instances/23866140-3332-491e-97e5-fb64f82ae13f/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Start _get_guest_xml network_info=[{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0fd8f9cb-4313-458d-b9a0-d8402adea087', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23866140-3332-491e-97e5-fb64f82ae13f', 'attached_at': '', 'detached_at': '', 'volume_id': '00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'serial': '00cf60fe-05fc-4be0-9628-ed934f1ab1ea'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:57:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:57:43 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:43 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:57:43 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[710a0ddb-e20c-4528-a592-def840cc6ef5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:57:43 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b312d9-b383-420d-9c26-6442b32f0b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea] added
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab523fe5-cfa9-4de0-ad71-3beb635d9f82]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c575a9-08df-4f2a-808d-6ed8372a6a44]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIXsEyBR {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mIXsEyBR" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[14411d85-2fa5-4703-9eec-abd849b3fca8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mIXsEyBR'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b508e2-f446-4bca-893e-db4316f7b17c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db269ad-2c65-4111-8dac-02742d6b6fa8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0441a5b7-a79a-4690-84a8-a6757ed37184]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]
Jul 27 16:57:43 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd32153-5d67-4d69-be75-65afdbec4853]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[766d841a-43c3-43e9-82b6-a0f45cf80a42]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:43 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:57:43 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:57:43 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c29b47-f0f7-431c-abba-7706570c6d40]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:57:43 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26337313166353132', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337313166353132', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-328384011',display_name='tempest-TestVolumeBootPattern-server-328384011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-328384011',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-98jrvakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:57:36Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=23866140-3332-491e-97e5-fb64f82ae13f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.objects.instance [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid 23866140-3332-491e-97e5-fb64f82ae13f {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:57:44 user nova-compute[71026]:   <uuid>23866140-3332-491e-97e5-fb64f82ae13f</uuid>
Jul 27 16:57:44 user nova-compute[71026]:   <name>instance-00000023</name>
Jul 27 16:57:44 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:57:44 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:57:44 user nova-compute[71026]:   <metadata>
Jul 27 16:57:44 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:57:44 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:57:44 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-server-328384011</nova:name>
Jul 27 16:57:44 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:57:43</nova:creationTime>
Jul 27 16:57:44 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:57:44 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:57:44 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:57:44 user nova-compute[71026]:       <nova:owner>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:57:44 user nova-compute[71026]:       </nova:owner>
Jul 27 16:57:44 user nova-compute[71026]:       <nova:ports>
Jul 27 16:57:44 user nova-compute[71026]:         <nova:port uuid="f7038f1e-dca3-4f75-b20b-6485e192bf66">
Jul 27 16:57:44 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 16:57:44 user nova-compute[71026]:         </nova:port>
Jul 27 16:57:44 user nova-compute[71026]:       </nova:ports>
Jul 27 16:57:44 user nova-compute[71026]:     </nova:instance>
Jul 27 16:57:44 user nova-compute[71026]:   </metadata>
Jul 27 16:57:44 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:57:44 user nova-compute[71026]:     <system>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="serial">23866140-3332-491e-97e5-fb64f82ae13f</entry>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="uuid">23866140-3332-491e-97e5-fb64f82ae13f</entry>
Jul 27 16:57:44 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:57:44 user nova-compute[71026]:     </system>
Jul 27 16:57:44 user nova-compute[71026]:   </sysinfo>
Jul 27 16:57:44 user nova-compute[71026]:   <os>
Jul 27 16:57:44 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:57:44 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:57:44 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:57:44 user nova-compute[71026]:   </os>
Jul 27 16:57:44 user nova-compute[71026]:   <features>
Jul 27 16:57:44 user nova-compute[71026]:     <acpi/>
Jul 27 16:57:44 user nova-compute[71026]:     <apic/>
Jul 27 16:57:44 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:57:44 user nova-compute[71026]:   </features>
Jul 27 16:57:44 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:57:44 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:57:44 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:57:44 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:57:44 user nova-compute[71026]:   </clock>
Jul 27 16:57:44 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:57:44 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:57:44 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:57:44 user nova-compute[71026]:   </cpu>
Jul 27 16:57:44 user nova-compute[71026]:   <devices>
Jul 27 16:57:44 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:57:44 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:57:44 user nova-compute[71026]:       <source dev="/dev/sdb"/>
Jul 27 16:57:44 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:57:44 user nova-compute[71026]:       <serial>00cf60fe-05fc-4be0-9628-ed934f1ab1ea</serial>
Jul 27 16:57:44 user nova-compute[71026]:     </disk>
Jul 27 16:57:44 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:57:44 user nova-compute[71026]:       <mac address="fa:16:3e:d5:fb:5f"/>
Jul 27 16:57:44 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:57:44 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:57:44 user nova-compute[71026]:       <target dev="tapf7038f1e-dc"/>
Jul 27 16:57:44 user nova-compute[71026]:     </interface>
Jul 27 16:57:44 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:57:44 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/23866140-3332-491e-97e5-fb64f82ae13f/console.log" append="off"/>
Jul 27 16:57:44 user nova-compute[71026]:     </serial>
Jul 27 16:57:44 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:57:44 user nova-compute[71026]:     <video>
Jul 27 16:57:44 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:57:44 user nova-compute[71026]:     </video>
Jul 27 16:57:44 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:57:44 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:57:44 user nova-compute[71026]:     </rng>
Jul 27 16:57:44 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:57:44 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:57:44 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:57:44 user nova-compute[71026]:     </memballoon>
Jul 27 16:57:44 user nova-compute[71026]:   </devices>
Jul 27 16:57:44 user nova-compute[71026]: </domain>
Jul 27 16:57:44 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-328384011',display_name='tempest-TestVolumeBootPattern-server-328384011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-328384011',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-98jrvakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:57:36Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=23866140-3332-491e-97e5-fb64f82ae13f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG os_vif [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7038f1e-dc, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7038f1e-dc, col_values=(('external_ids', {'iface-id': 'f7038f1e-dca3-4f75-b20b-6485e192bf66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:fb:5f', 'vm-uuid': '23866140-3332-491e-97e5-fb64f82ae13f'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:44 user nova-compute[71026]: INFO os_vif [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc')
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:57:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:d5:fb:5f, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] No waiting events found dispatching network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:45 user nova-compute[71026]: WARNING nova.compute.manager [req-ebdc50ac-7c72-492c-bb98-91d3d324974b req-9220fe82-8e7d-4be1-9afe-8ced2a149703 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received unexpected event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 for instance with vm_state building and task_state spawning.
Jul 27 16:57:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477067.861161, 23866140-3332-491e-97e5-fb64f82ae13f => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] VM Resumed (Lifecycle Event)
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Instance spawned successfully.
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477067.863469, 23866140-3332-491e-97e5-fb64f82ae13f => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] VM Started (Lifecycle Event)
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:57:47 user nova-compute[71026]: INFO nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 27 16:57:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] No waiting events found dispatching network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:48 user nova-compute[71026]: WARNING nova.compute.manager [req-9251f5e3-e82b-4829-961e-0b15f450265d req-eda3166d-4c15-4488-a3b0-dc38a28ff7af service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received unexpected event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 for instance with vm_state building and task_state spawning.
Jul 27 16:57:48 user nova-compute[71026]: INFO nova.compute.manager [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Took 12.59 seconds to build instance.
Jul 27 16:57:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84df86d7-0aac-4b3b-9eab-3792cdd28988 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.680s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:52 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:57:52 user nova-compute[71026]: INFO nova.compute.claims [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Claim successful on node user
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:57:53 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.policy [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d174521a64249cca028d0420c4ddf96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63abb5340f1b41f0be26171843ffcff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:57:53 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Creating image(s)
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "/opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "/opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "/opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.127s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk 1073741824" returned: 0 in 0.052s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:57:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Cannot resize image /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'migration_context' on Instance uuid 19dedd10-10f6-46ff-a35e-b80126aa1f53 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Ensure instance console log exists: /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Successfully created port: 063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Successfully updated port: 063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquired lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:57:54 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-changed-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Refreshing instance network info cache due to event network-changed-063f4c1a-c60c-4fa0-b0ab-babac4e533fc. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] Acquiring lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Updating instance_info_cache with network_info: [{"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Releasing lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Instance network_info: |[{"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] Acquired lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Refreshing network info cache for port 063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Start _get_guest_xml network_info=[{"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:57:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209195022',display_name='tempest-VolumesActionsTest-instance-209195022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209195022',id=36,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-etx41bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:57:53Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=19dedd10-10f6-46ff-a35e-b80126aa1f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'pci_devices' on Instance uuid 19dedd10-10f6-46ff-a35e-b80126aa1f53 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:57:55 user nova-compute[71026]:   <uuid>19dedd10-10f6-46ff-a35e-b80126aa1f53</uuid>
Jul 27 16:57:55 user nova-compute[71026]:   <name>instance-00000024</name>
Jul 27 16:57:55 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:57:55 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:57:55 user nova-compute[71026]:   <metadata>
Jul 27 16:57:55 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:57:55 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:name>tempest-VolumesActionsTest-instance-209195022</nova:name>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:57:55</nova:creationTime>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:57:55 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:57:55 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:owner>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:user uuid="3d174521a64249cca028d0420c4ddf96">tempest-VolumesActionsTest-837956822-project-member</nova:user>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:project uuid="63abb5340f1b41f0be26171843ffcff5">tempest-VolumesActionsTest-837956822</nova:project>
Jul 27 16:57:55 user nova-compute[71026]:       </nova:owner>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:57:55 user nova-compute[71026]:       <nova:ports>
Jul 27 16:57:55 user nova-compute[71026]:         <nova:port uuid="063f4c1a-c60c-4fa0-b0ab-babac4e533fc">
Jul 27 16:57:55 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 16:57:55 user nova-compute[71026]:         </nova:port>
Jul 27 16:57:55 user nova-compute[71026]:       </nova:ports>
Jul 27 16:57:55 user nova-compute[71026]:     </nova:instance>
Jul 27 16:57:55 user nova-compute[71026]:   </metadata>
Jul 27 16:57:55 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:57:55 user nova-compute[71026]:     <system>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="serial">19dedd10-10f6-46ff-a35e-b80126aa1f53</entry>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="uuid">19dedd10-10f6-46ff-a35e-b80126aa1f53</entry>
Jul 27 16:57:55 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:57:55 user nova-compute[71026]:     </system>
Jul 27 16:57:55 user nova-compute[71026]:   </sysinfo>
Jul 27 16:57:55 user nova-compute[71026]:   <os>
Jul 27 16:57:55 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:57:55 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:57:55 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:57:55 user nova-compute[71026]:   </os>
Jul 27 16:57:55 user nova-compute[71026]:   <features>
Jul 27 16:57:55 user nova-compute[71026]:     <acpi/>
Jul 27 16:57:55 user nova-compute[71026]:     <apic/>
Jul 27 16:57:55 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:57:55 user nova-compute[71026]:   </features>
Jul 27 16:57:55 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:57:55 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:57:55 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:57:55 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:57:55 user nova-compute[71026]:   </clock>
Jul 27 16:57:55 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:57:55 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:57:55 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:57:55 user nova-compute[71026]:   </cpu>
Jul 27 16:57:55 user nova-compute[71026]:   <devices>
Jul 27 16:57:55 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:57:55 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:57:55 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk"/>
Jul 27 16:57:55 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:57:55 user nova-compute[71026]:     </disk>
Jul 27 16:57:55 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:57:55 user nova-compute[71026]:       <mac address="fa:16:3e:8d:6a:2b"/>
Jul 27 16:57:55 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:57:55 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:57:55 user nova-compute[71026]:       <target dev="tap063f4c1a-c6"/>
Jul 27 16:57:55 user nova-compute[71026]:     </interface>
Jul 27 16:57:55 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:57:55 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/console.log" append="off"/>
Jul 27 16:57:55 user nova-compute[71026]:     </serial>
Jul 27 16:57:55 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:57:55 user nova-compute[71026]:     <video>
Jul 27 16:57:55 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:57:55 user nova-compute[71026]:     </video>
Jul 27 16:57:55 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:57:55 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:57:55 user nova-compute[71026]:     </rng>
Jul 27 16:57:55 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:57:55 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:57:55 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:57:55 user nova-compute[71026]:     </memballoon>
Jul 27 16:57:55 user nova-compute[71026]:   </devices>
Jul 27 16:57:55 user nova-compute[71026]: </domain>
Jul 27 16:57:55 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209195022',display_name='tempest-VolumesActionsTest-instance-209195022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209195022',id=36,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-etx41bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:57:53Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=19dedd10-10f6-46ff-a35e-b80126aa1f53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG os_vif [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap063f4c1a-c6, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap063f4c1a-c6, col_values=(('external_ids', {'iface-id': '063f4c1a-c60c-4fa0-b0ab-babac4e533fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:6a:2b', 'vm-uuid': '19dedd10-10f6-46ff-a35e-b80126aa1f53'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:55 user nova-compute[71026]: INFO os_vif [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6')
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] No VIF found with MAC fa:16:3e:8d:6a:2b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Updated VIF entry in instance network info cache for port 063f4c1a-c60c-4fa0-b0ab-babac4e533fc. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG nova.network.neutron [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Updating instance_info_cache with network_info: [{"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:57:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8975ddb5-af29-4c93-abd2-d40b3412b009 req-3f6ac406-9c4d-42a7-8cdb-bb0bb0ab53fe service nova] Releasing lock "refresh_cache-19dedd10-10f6-46ff-a35e-b80126aa1f53" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:57:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] No waiting events found dispatching network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:57 user nova-compute[71026]: WARNING nova.compute.manager [req-5d0dbb7a-9461-4e67-b42f-68b6982ab79b req-c54b59bd-d13d-4007-8821-67baadd90ab8 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received unexpected event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc for instance with vm_state building and task_state spawning.
Jul 27 16:57:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477078.820364, 19dedd10-10f6-46ff-a35e-b80126aa1f53 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] VM Resumed (Lifecycle Event)
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Instance spawned successfully.
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477078.821537, 19dedd10-10f6-46ff-a35e-b80126aa1f53 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] VM Started (Lifecycle Event)
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:57:58 user nova-compute[71026]: INFO nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Took 5.43 seconds to spawn the instance on the hypervisor.
Jul 27 16:57:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:57:59 user nova-compute[71026]: INFO nova.compute.manager [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Took 6.21 seconds to build instance.
Jul 27 16:57:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2cfc421d-7185-46d4-8db0-72267f094606 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.308s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:57:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:57:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:57:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:57:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] No waiting events found dispatching network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:57:59 user nova-compute[71026]: WARNING nova.compute.manager [req-492f9374-96d4-43b3-a452-0dacc60dd5d6 req-3af54702-8b57-4c1f-912f-e4002bc06626 service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received unexpected event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc for instance with vm_state active and task_state None.
Jul 27 16:57:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing instance network info cache due to event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updated VIF entry in instance network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1b315bd-3b21-4cb3-a4ed-44a245383a37 req-9a49137a-c9d8-4d14-b41d-e5641b0b9e96 service nova] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:26 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:29 user nova-compute[71026]: INFO nova.compute.manager [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Shelving
Jul 27 16:58:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:58:30 user nova-compute[71026]: WARNING nova.compute.manager [req-253cd9b7-f762-4183-9c6d-78cb406b2582 req-b324cb87-788b-4d6c-a76c-4a85411807da service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state active and task_state shelving.
Jul 27 16:58:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:30 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance destroyed successfully.
Jul 27 16:58:30 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Beginning cold snapshot process
Jul 27 16:58:30 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 16:58:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk /opt/stack/data/nova/instances/snapshots/tmp5217jljf/c0ff359e307b484ca1f39d9fcad4311d {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk /opt/stack/data/nova/instances/snapshots/tmp5217jljf/c0ff359e307b484ca1f39d9fcad4311d" returned: 0 in 0.650s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Snapshot extracted, beginning image upload
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:58:32 user nova-compute[71026]: WARNING nova.compute.manager [req-7b56b146-c6fa-45c7-8305-a592426ad82c req-171bc58c-b48b-4bba-84c3-b8376066347b service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 16:58:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Snapshot image upload complete
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:34 user nova-compute[71026]: INFO nova.compute.manager [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Shelve offloading
Jul 27 16:58:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance destroyed successfully.
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:58:34 user nova-compute[71026]: INFO nova.compute.claims [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Claim successful on node user
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:58:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:34 user nova-compute[71026]: DEBUG nova.policy [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c742ca26757400288ef69caac251d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbbd8fb9af44b38b4c48be901f137a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:58:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Creating image(s)
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing instance network info cache due to event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.network.neutron [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.617s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:58:35 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:58:35 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8238MB free_disk=25.49413299560547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk 1073741824" returned: 0 in 0.310s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.931s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Successfully created port: 19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:58:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance destroyed successfully.
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'resources' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKspkk7w+FwtZQTLfjMBa/GZrR8Qmlkilyj67/n7Sa0+jnV9l7wAyDo6tff0DUzGromfCPkof+uL8AP61i11zb78DnUkWhykQRsL0iLbfHgX6TDXpnNF8Nz2ZfnGxIO+ZA==',key_name='tempest-keypair-539704832',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:56:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T16:58:34.020516',shelved_host='user',shelved_image_id='b027c33e-ccf6-49cb-a402-02a47d644fb5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:58:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG os_vif [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22bca0c-a4, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e5aa2385-ce14-4055-9aa4-666bbeb33dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 23866140-3332-491e-97e5-fb64f82ae13f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 19dedd10-10f6-46ff-a35e-b80126aa1f53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:58:36 user nova-compute[71026]: INFO os_vif [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4')
Jul 27 16:58:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Deleting instance files /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac_del
Jul 27 16:58:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Deletion of /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac_del complete
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:58:36 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Deleted allocations for instance e5aa2385-ce14-4055-9aa4-666bbeb33dac
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Cannot resize image /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'migration_context' on Instance uuid 4a661cd6-8dfb-4266-a5ca-cea210c9080a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Ensure instance console log exists: /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.070s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'numa_topology' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updated VIF entry in instance network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5bc99138-14c9-47b4-a889-9d42fe39a4c5 req-b7d7cf6b-dcf1-46a3-af22-3a0a356cdd65 service nova] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e4303768-4af3-4228-8c7c-03e1204f5c4a tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.068s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Successfully updated port: 19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-changed-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Refreshing instance network info cache due to event network-changed-19bb9e91-7f88-46a5-a416-85c294b49646. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] Acquiring lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updating instance_info_cache with network_info: [{"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Instance network_info: |[{"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] Acquired lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.neutron [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Refreshing network info cache for port 19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Start _get_guest_xml network_info=[{"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:58:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:58:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1763282222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1763282222',id=37,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-4nfjhr5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:58:35Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=4a661cd6-8dfb-4266-a5ca-cea210c9080a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a661cd6-8dfb-4266-a5ca-cea210c9080a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:58:37 user nova-compute[71026]:   <uuid>4a661cd6-8dfb-4266-a5ca-cea210c9080a</uuid>
Jul 27 16:58:37 user nova-compute[71026]:   <name>instance-00000025</name>
Jul 27 16:58:37 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:58:37 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:58:37 user nova-compute[71026]:   <metadata>
Jul 27 16:58:37 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:58:37 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1763282222</nova:name>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:58:37</nova:creationTime>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:58:37 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:58:37 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:owner>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 16:58:37 user nova-compute[71026]:       </nova:owner>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:58:37 user nova-compute[71026]:       <nova:ports>
Jul 27 16:58:37 user nova-compute[71026]:         <nova:port uuid="19bb9e91-7f88-46a5-a416-85c294b49646">
Jul 27 16:58:37 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 27 16:58:37 user nova-compute[71026]:         </nova:port>
Jul 27 16:58:37 user nova-compute[71026]:       </nova:ports>
Jul 27 16:58:37 user nova-compute[71026]:     </nova:instance>
Jul 27 16:58:37 user nova-compute[71026]:   </metadata>
Jul 27 16:58:37 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:58:37 user nova-compute[71026]:     <system>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="serial">4a661cd6-8dfb-4266-a5ca-cea210c9080a</entry>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="uuid">4a661cd6-8dfb-4266-a5ca-cea210c9080a</entry>
Jul 27 16:58:37 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:58:37 user nova-compute[71026]:     </system>
Jul 27 16:58:37 user nova-compute[71026]:   </sysinfo>
Jul 27 16:58:37 user nova-compute[71026]:   <os>
Jul 27 16:58:37 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:58:37 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:58:37 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:58:37 user nova-compute[71026]:   </os>
Jul 27 16:58:37 user nova-compute[71026]:   <features>
Jul 27 16:58:37 user nova-compute[71026]:     <acpi/>
Jul 27 16:58:37 user nova-compute[71026]:     <apic/>
Jul 27 16:58:37 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:58:37 user nova-compute[71026]:   </features>
Jul 27 16:58:37 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:58:37 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:58:37 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:58:37 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:58:37 user nova-compute[71026]:   </clock>
Jul 27 16:58:37 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:58:37 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:58:37 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:58:37 user nova-compute[71026]:   </cpu>
Jul 27 16:58:37 user nova-compute[71026]:   <devices>
Jul 27 16:58:37 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:58:37 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:58:37 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk"/>
Jul 27 16:58:37 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:58:37 user nova-compute[71026]:     </disk>
Jul 27 16:58:37 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:58:37 user nova-compute[71026]:       <mac address="fa:16:3e:ae:44:84"/>
Jul 27 16:58:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:58:37 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:58:37 user nova-compute[71026]:       <target dev="tap19bb9e91-7f"/>
Jul 27 16:58:37 user nova-compute[71026]:     </interface>
Jul 27 16:58:37 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:58:37 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/console.log" append="off"/>
Jul 27 16:58:37 user nova-compute[71026]:     </serial>
Jul 27 16:58:37 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:58:37 user nova-compute[71026]:     <video>
Jul 27 16:58:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:58:37 user nova-compute[71026]:     </video>
Jul 27 16:58:37 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:58:37 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:58:37 user nova-compute[71026]:     </rng>
Jul 27 16:58:37 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:58:37 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:58:37 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:58:37 user nova-compute[71026]:     </memballoon>
Jul 27 16:58:37 user nova-compute[71026]:   </devices>
Jul 27 16:58:37 user nova-compute[71026]: </domain>
Jul 27 16:58:37 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1763282222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1763282222',id=37,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-4nfjhr5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:58:35Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=4a661cd6-8dfb-4266-a5ca-cea210c9080a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG os_vif [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19bb9e91-7f, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19bb9e91-7f, col_values=(('external_ids', {'iface-id': '19bb9e91-7f88-46a5-a416-85c294b49646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:44:84', 'vm-uuid': '4a661cd6-8dfb-4266-a5ca-cea210c9080a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:37 user nova-compute[71026]: INFO os_vif [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f')
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:58:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:ae:44:84, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:58:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updated VIF entry in instance network info cache for port 19bb9e91-7f88-46a5-a416-85c294b49646. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:58:38 user nova-compute[71026]: DEBUG nova.network.neutron [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updating instance_info_cache with network_info: [{"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:58:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b10b8fa1-39a6-4859-b332-28cea36940f7 req-c7867752-09b6-4b32-95cb-c9521c74ae7a service nova] Releasing lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] No waiting events found dispatching network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:58:39 user nova-compute[71026]: WARNING nova.compute.manager [req-d5fdc06c-f15d-4716-a07e-91fcca6f01b2 req-8335fdce-c2f1-408f-a9d8-12708def83d9 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received unexpected event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 for instance with vm_state building and task_state spawning.
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477121.2087693, 4a661cd6-8dfb-4266-a5ca-cea210c9080a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] VM Resumed (Lifecycle Event)
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Instance spawned successfully.
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477121.2166445, 4a661cd6-8dfb-4266-a5ca-cea210c9080a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] VM Started (Lifecycle Event)
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Took 6.28 seconds to spawn the instance on the hypervisor.
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] No waiting events found dispatching network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:58:41 user nova-compute[71026]: WARNING nova.compute.manager [req-50bceacc-f8a6-42cf-b358-d358d706a3ac req-bf0f9764-e00c-4892-8c94-5f0f10a03bec service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received unexpected event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 for instance with vm_state active and task_state None.
Jul 27 16:58:41 user nova-compute[71026]: INFO nova.compute.manager [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Took 7.14 seconds to build instance.
Jul 27 16:58:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf401536-99fc-4e08-baff-be7b2181280e tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:58:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:45 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477110.5723996, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:58:45 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Stopped (Lifecycle Event)
Jul 27 16:58:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-bdd5f5ec-1462-40ef-bed8-f90b1352e759 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:58:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:58:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 16:58:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:58:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing instance network info cache due to event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] Acquiring lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] Acquired lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updated VIF entry in instance network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5d22b3d-49ac-4c46-a2cb-63806ad7eb09 req-ae414e84-c524-4bde-a2e8-c7519ed8a01e service nova] Releasing lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:59:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 16:59:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:59:33 user nova-compute[71026]: INFO nova.compute.claims [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Claim successful on node user
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:59:33 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:59:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:59:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Creating image(s)
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "/opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "/opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.policy [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '914c6d75846846a2b944bfb6111f0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453f1bd5d8b347be913fe262b31a1c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk 1073741824" returned: 0 in 0.056s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Cannot resize image /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'migration_context' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Ensure instance console log exists: /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Successfully created port: 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Successfully updated port: 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing instance network info cache due to event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] Acquiring lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] Acquired lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing network info cache for port 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dcd83d56-9233-40d3-bd99-276b669d0f25 req-8f32b86d-df40-4b97-b0a0-14bb5f9ffed5 service nova] Releasing lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquired lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Releasing lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance network_info: |[{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Start _get_guest_xml network_info=[{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:59:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-11091794',display_name='tempest-TestStampPattern-server-11091794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-11091794',id=38,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-52tjkuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:59:34Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=6e950d30-892f-471b-82d2-f435da94a63d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:59:37 user nova-compute[71026]:   <uuid>6e950d30-892f-471b-82d2-f435da94a63d</uuid>
Jul 27 16:59:37 user nova-compute[71026]:   <name>instance-00000026</name>
Jul 27 16:59:37 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:59:37 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:59:37 user nova-compute[71026]:   <metadata>
Jul 27 16:59:37 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:59:37 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:name>tempest-TestStampPattern-server-11091794</nova:name>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:59:37</nova:creationTime>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:59:37 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:59:37 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:owner>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:user uuid="914c6d75846846a2b944bfb6111f0341">tempest-TestStampPattern-853432287-project-member</nova:user>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:project uuid="453f1bd5d8b347be913fe262b31a1c66">tempest-TestStampPattern-853432287</nova:project>
Jul 27 16:59:37 user nova-compute[71026]:       </nova:owner>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 16:59:37 user nova-compute[71026]:       <nova:ports>
Jul 27 16:59:37 user nova-compute[71026]:         <nova:port uuid="74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8">
Jul 27 16:59:37 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 16:59:37 user nova-compute[71026]:         </nova:port>
Jul 27 16:59:37 user nova-compute[71026]:       </nova:ports>
Jul 27 16:59:37 user nova-compute[71026]:     </nova:instance>
Jul 27 16:59:37 user nova-compute[71026]:   </metadata>
Jul 27 16:59:37 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:59:37 user nova-compute[71026]:     <system>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="serial">6e950d30-892f-471b-82d2-f435da94a63d</entry>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="uuid">6e950d30-892f-471b-82d2-f435da94a63d</entry>
Jul 27 16:59:37 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:59:37 user nova-compute[71026]:     </system>
Jul 27 16:59:37 user nova-compute[71026]:   </sysinfo>
Jul 27 16:59:37 user nova-compute[71026]:   <os>
Jul 27 16:59:37 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:59:37 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:59:37 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:59:37 user nova-compute[71026]:   </os>
Jul 27 16:59:37 user nova-compute[71026]:   <features>
Jul 27 16:59:37 user nova-compute[71026]:     <acpi/>
Jul 27 16:59:37 user nova-compute[71026]:     <apic/>
Jul 27 16:59:37 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:59:37 user nova-compute[71026]:   </features>
Jul 27 16:59:37 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:59:37 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:59:37 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:59:37 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:59:37 user nova-compute[71026]:   </clock>
Jul 27 16:59:37 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:59:37 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:59:37 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:59:37 user nova-compute[71026]:   </cpu>
Jul 27 16:59:37 user nova-compute[71026]:   <devices>
Jul 27 16:59:37 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 16:59:37 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 16:59:37 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk"/>
Jul 27 16:59:37 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:59:37 user nova-compute[71026]:     </disk>
Jul 27 16:59:37 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:59:37 user nova-compute[71026]:       <mac address="fa:16:3e:a1:2f:47"/>
Jul 27 16:59:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:59:37 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:59:37 user nova-compute[71026]:       <target dev="tap74ab015f-77"/>
Jul 27 16:59:37 user nova-compute[71026]:     </interface>
Jul 27 16:59:37 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:59:37 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/console.log" append="off"/>
Jul 27 16:59:37 user nova-compute[71026]:     </serial>
Jul 27 16:59:37 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:59:37 user nova-compute[71026]:     <video>
Jul 27 16:59:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:59:37 user nova-compute[71026]:     </video>
Jul 27 16:59:37 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:59:37 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:59:37 user nova-compute[71026]:     </rng>
Jul 27 16:59:37 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:59:37 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:59:37 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:59:37 user nova-compute[71026]:     </memballoon>
Jul 27 16:59:37 user nova-compute[71026]:   </devices>
Jul 27 16:59:37 user nova-compute[71026]: </domain>
Jul 27 16:59:37 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-11091794',display_name='tempest-TestStampPattern-server-11091794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-11091794',id=38,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-52tjkuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:59:34Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=6e950d30-892f-471b-82d2-f435da94a63d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG os_vif [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74ab015f-77, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74ab015f-77, col_values=(('external_ids', {'iface-id': '74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:2f:47', 'vm-uuid': '6e950d30-892f-471b-82d2-f435da94a63d'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:37 user nova-compute[71026]: INFO os_vif [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77')
Jul 27 16:59:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:37 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=25.48175048828125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No VIF found with MAC fa:16:3e:a1:2f:47, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 23866140-3332-491e-97e5-fb64f82ae13f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 19dedd10-10f6-46ff-a35e-b80126aa1f53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 16:59:37 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 16:59:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:59:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:59:38 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 16:59:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] No waiting events found dispatching network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:39 user nova-compute[71026]: WARNING nova.compute.manager [req-90263418-0662-4d43-9a23-9d4c024bf472 req-b0148020-4433-4b3d-93bd-a19541f39dee service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received unexpected event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 for instance with vm_state building and task_state spawning.
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 16:59:40 user nova-compute[71026]: INFO nova.compute.claims [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Claim successful on node user
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 16:59:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 16:59:40 user nova-compute[71026]: INFO nova.virt.block_device [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Booting with volume 33929e7d-57fe-43ec-9233-149d882db851 at /dev/vda
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.policy [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6fe5c1c7f7f45299502eb927269a7eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3985a0dd491c44958ba564c9c8ef6e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.utils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a93fc-96f2-45eb-9744-e8db8cd23dfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[007475c0-5567-431b-866d-4ee4b4027217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda5b627-10cd-4839-b916-4b30461a9624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2280792-5490-4481-8a69-ea96b17808ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 16:59:40 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 16:59:40 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdf1ac0-730f-4e00-8b2d-9bf4217016ec]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG os_brick.utils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:59:40 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating existing volume attachment record: b09d446b-a2a7-4758-ae7e-9050db319fc8 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477181.3072786, 6e950d30-892f-471b-82d2-f435da94a63d => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] VM Resumed (Lifecycle Event)
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance spawned successfully.
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477181.3084679, 6e950d30-892f-471b-82d2-f435da94a63d => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] VM Started (Lifecycle Event)
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Took 7.22 seconds to spawn the instance on the hypervisor.
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Successfully created port: 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 16:59:41 user nova-compute[71026]: INFO nova.compute.manager [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Took 7.93 seconds to build instance.
Jul 27 16:59:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-691958df-4f24-43e2-b950-36fc2eb3649d tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.035s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] No waiting events found dispatching network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:41 user nova-compute[71026]: WARNING nova.compute.manager [req-c2fcfb67-fffb-4389-b527-6a0920a0dd73 req-7e314e51-a014-46e0-b252-c0b2dc914059 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received unexpected event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 for instance with vm_state active and task_state None.
Jul 27 16:59:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Successfully updated port: 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquired lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating instance_info_cache with network_info: [{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Releasing lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:59:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Instance network_info: |[{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing instance network info cache due to event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] Acquiring lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] Acquired lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:43 user nova-compute[71026]: INFO nova.compute.manager [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Terminating instance
Jul 27 16:59:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Instance destroyed successfully.
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.objects.instance [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lazy-loading 'resources' on Instance uuid 19dedd10-10f6-46ff-a35e-b80126aa1f53 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-209195022',display_name='tempest-VolumesActionsTest-instance-209195022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-209195022',id=36,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63abb5340f1b41f0be26171843ffcff5',ramdisk_id='',reservation_id='r-etx41bef',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-837956822',owner_user_name='tempest-VolumesActionsTest-837956822-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:57:59Z,user_data=None,user_id='3d174521a64249cca028d0420c4ddf96',uuid=19dedd10-10f6-46ff-a35e-b80126aa1f53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converting VIF {"id": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "address": "fa:16:3e:8d:6a:2b", "network": {"id": "aeecc504-0c02-4d89-b7c3-6346a3ff43e1", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1408628208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abb5340f1b41f0be26171843ffcff5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063f4c1a-c6", "ovs_interfaceid": "063f4c1a-c60c-4fa0-b0ab-babac4e533fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG os_vif [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap063f4c1a-c6, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updated VIF entry in instance network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.network.neutron [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating instance_info_cache with network_info: [{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:59:44 user nova-compute[71026]: INFO os_vif [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:6a:2b,bridge_name='br-int',has_traffic_filtering=True,id=063f4c1a-c60c-4fa0-b0ab-babac4e533fc,network=Network(aeecc504-0c02-4d89-b7c3-6346a3ff43e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063f4c1a-c6')
Jul 27 16:59:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Deleting instance files /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53_del
Jul 27 16:59:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Deletion of /opt/stack/data/nova/instances/19dedd10-10f6-46ff-a35e-b80126aa1f53_del complete
Jul 27 16:59:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1d4e797f-1cdb-4188-a8b1-9ce99faa4dc6 req-3064f497-833f-4c95-b46c-33116d304c96 service nova] Releasing lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:44 user nova-compute[71026]: INFO nova.compute.manager [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Took 0.76 seconds to destroy the instance on the hypervisor.
Jul 27 16:59:44 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 16:59:44 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 16:59:45 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Took 0.60 seconds to deallocate network for instance.
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:45 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Deleted allocations for instance 19dedd10-10f6-46ff-a35e-b80126aa1f53
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-841f6a39-409e-4179-9d78-81250822a169 tempest-VolumesActionsTest-837956822 tempest-VolumesActionsTest-837956822-project-member] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-vif-unplugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] No waiting events found dispatching network-vif-unplugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:45 user nova-compute[71026]: WARNING nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received unexpected event network-vif-unplugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc for instance with vm_state deleted and task_state None.
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Acquiring lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] Lock "19dedd10-10f6-46ff-a35e-b80126aa1f53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] No waiting events found dispatching network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:45 user nova-compute[71026]: WARNING nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received unexpected event network-vif-plugged-063f4c1a-c60c-4fa0-b0ab-babac4e533fc for instance with vm_state deleted and task_state None.
Jul 27 16:59:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-2e6929de-f027-48c3-adcb-c3ed3a2b9e4f req-57bd5147-2e33-4571-9162-a1a332c620ef service nova] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Received event network-vif-deleted-063f4c1a-c60c-4fa0-b0ab-babac4e533fc {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 16:59:48 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Creating image(s)
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Ensure instance console log exists: /opt/stack/data/nova/instances/66a6cab1-92b5-4124-995d-420221399d45/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Start _get_guest_xml network_info=[{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b09d446b-a2a7-4758-ae7e-9050db319fc8', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxMdwGoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66a6cab1-92b5-4124-995d-420221399d45', 'attached_at': '', 'detached_at': '', 'volume_id': '33929e7d-57fe-43ec-9233-149d882db851', 'serial': '33929e7d-57fe-43ec-9233-149d882db851'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 16:59:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxMdwGoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 16:59:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:59:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 16:59:48 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f107628f-e492-4b90-a61f-16faa368e83e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 16:59:48 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30df2d2-ca0d-4d71-8375-fea05be4780c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851] added
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c4dbba-3a3f-4a0b-a60b-c617ed0002bc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[962de08b-7ec1-4320-85f6-e76ba62eb497]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxMdwGoB {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxMdwGoB" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf4ec6-93d6-4e91-8c9e-5d1aa2793ab4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxMdwGoB'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0cdf57-b828-464f-9108-bc709ccafc10]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9ab27-bf90-4113-ba55-b128c5b50691]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbab480-1783-4cea-a9fa-bb3e67ba1902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260]
Jul 27 16:59:48 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260] successful.
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80cfe49-48f8-40c1-8282-86175f3980e8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb77a12-73c7-4d0d-a926-02a4aa2eec18]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 16:59:48 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 16:59:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98bef2-1c1d-42a4-8971-1aec95f2fd36]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 16:59:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxMdwGoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26330396162356531', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330396162356531', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1093725815',display_name='tempest-TestVolumeBootPattern-server-1093725815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1093725815',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-32awrx60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:59:41Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=66a6cab1-92b5-4124-995d-420221399d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'pci_devices' on Instance uuid 66a6cab1-92b5-4124-995d-420221399d45 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] End _get_guest_xml xml=<domain type="kvm">
Jul 27 16:59:49 user nova-compute[71026]:   <uuid>66a6cab1-92b5-4124-995d-420221399d45</uuid>
Jul 27 16:59:49 user nova-compute[71026]:   <name>instance-00000027</name>
Jul 27 16:59:49 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 16:59:49 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 16:59:49 user nova-compute[71026]:   <metadata>
Jul 27 16:59:49 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 16:59:49 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 16:59:49 user nova-compute[71026]:       <nova:name>tempest-TestVolumeBootPattern-server-1093725815</nova:name>
Jul 27 16:59:49 user nova-compute[71026]:       <nova:creationTime>2023-07-27 16:59:48</nova:creationTime>
Jul 27 16:59:49 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 16:59:49 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 16:59:49 user nova-compute[71026]:       </nova:flavor>
Jul 27 16:59:49 user nova-compute[71026]:       <nova:owner>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:user uuid="b6fe5c1c7f7f45299502eb927269a7eb">tempest-TestVolumeBootPattern-2066891657-project-member</nova:user>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:project uuid="3985a0dd491c44958ba564c9c8ef6e4f">tempest-TestVolumeBootPattern-2066891657</nova:project>
Jul 27 16:59:49 user nova-compute[71026]:       </nova:owner>
Jul 27 16:59:49 user nova-compute[71026]:       <nova:ports>
Jul 27 16:59:49 user nova-compute[71026]:         <nova:port uuid="9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9">
Jul 27 16:59:49 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 27 16:59:49 user nova-compute[71026]:         </nova:port>
Jul 27 16:59:49 user nova-compute[71026]:       </nova:ports>
Jul 27 16:59:49 user nova-compute[71026]:     </nova:instance>
Jul 27 16:59:49 user nova-compute[71026]:   </metadata>
Jul 27 16:59:49 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 16:59:49 user nova-compute[71026]:     <system>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="serial">66a6cab1-92b5-4124-995d-420221399d45</entry>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="uuid">66a6cab1-92b5-4124-995d-420221399d45</entry>
Jul 27 16:59:49 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 16:59:49 user nova-compute[71026]:     </system>
Jul 27 16:59:49 user nova-compute[71026]:   </sysinfo>
Jul 27 16:59:49 user nova-compute[71026]:   <os>
Jul 27 16:59:49 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 16:59:49 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 16:59:49 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 16:59:49 user nova-compute[71026]:   </os>
Jul 27 16:59:49 user nova-compute[71026]:   <features>
Jul 27 16:59:49 user nova-compute[71026]:     <acpi/>
Jul 27 16:59:49 user nova-compute[71026]:     <apic/>
Jul 27 16:59:49 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 16:59:49 user nova-compute[71026]:   </features>
Jul 27 16:59:49 user nova-compute[71026]:   <clock offset="utc">
Jul 27 16:59:49 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 16:59:49 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 16:59:49 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 16:59:49 user nova-compute[71026]:   </clock>
Jul 27 16:59:49 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 16:59:49 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 16:59:49 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 16:59:49 user nova-compute[71026]:   </cpu>
Jul 27 16:59:49 user nova-compute[71026]:   <devices>
Jul 27 16:59:49 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 16:59:49 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 16:59:49 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 16:59:49 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 16:59:49 user nova-compute[71026]:       <serial>33929e7d-57fe-43ec-9233-149d882db851</serial>
Jul 27 16:59:49 user nova-compute[71026]:     </disk>
Jul 27 16:59:49 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 16:59:49 user nova-compute[71026]:       <mac address="fa:16:3e:9a:15:c9"/>
Jul 27 16:59:49 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:59:49 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 16:59:49 user nova-compute[71026]:       <target dev="tap9d49bd9e-67"/>
Jul 27 16:59:49 user nova-compute[71026]:     </interface>
Jul 27 16:59:49 user nova-compute[71026]:     <serial type="pty">
Jul 27 16:59:49 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/66a6cab1-92b5-4124-995d-420221399d45/console.log" append="off"/>
Jul 27 16:59:49 user nova-compute[71026]:     </serial>
Jul 27 16:59:49 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 16:59:49 user nova-compute[71026]:     <video>
Jul 27 16:59:49 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 16:59:49 user nova-compute[71026]:     </video>
Jul 27 16:59:49 user nova-compute[71026]:     <rng model="virtio">
Jul 27 16:59:49 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 16:59:49 user nova-compute[71026]:     </rng>
Jul 27 16:59:49 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 16:59:49 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 16:59:49 user nova-compute[71026]:       <stats period="10"/>
Jul 27 16:59:49 user nova-compute[71026]:     </memballoon>
Jul 27 16:59:49 user nova-compute[71026]:   </devices>
Jul 27 16:59:49 user nova-compute[71026]: </domain>
Jul 27 16:59:49 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1093725815',display_name='tempest-TestVolumeBootPattern-server-1093725815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1093725815',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-32awrx60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T16:59:41Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=66a6cab1-92b5-4124-995d-420221399d45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG os_vif [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d49bd9e-67, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d49bd9e-67, col_values=(('external_ids', {'iface-id': '9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:15:c9', 'vm-uuid': '66a6cab1-92b5-4124-995d-420221399d45'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:49 user nova-compute[71026]: INFO os_vif [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67')
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 16:59:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] No VIF found with MAC fa:16:3e:9a:15:c9, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 16:59:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] No waiting events found dispatching network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:51 user nova-compute[71026]: WARNING nova.compute.manager [req-2611a1b1-708d-4165-8bd4-9a8a35a76c9f req-43608be0-009f-4c57-9803-d0ddaac56009 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received unexpected event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 for instance with vm_state building and task_state spawning.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477193.0967956, 66a6cab1-92b5-4124-995d-420221399d45 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] VM Resumed (Lifecycle Event)
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Instance spawned successfully.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477193.1002567, 66a6cab1-92b5-4124-995d-420221399d45 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] VM Started (Lifecycle Event)
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Took 4.99 seconds to spawn the instance on the hypervisor.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:53 user nova-compute[71026]: DEBUG nova.compute.manager [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] No waiting events found dispatching network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 16:59:53 user nova-compute[71026]: WARNING nova.compute.manager [req-8dbb69aa-6493-421b-9079-1903cb25b009 req-a640b2ac-5575-43fa-9b42-af4be5123407 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received unexpected event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 for instance with vm_state building and task_state spawning.
Jul 27 16:59:53 user nova-compute[71026]: INFO nova.compute.manager [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Took 13.02 seconds to build instance.
Jul 27 16:59:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6d73bbbb-8b09-4a25-9258-be9642b51632 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.122s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 16:59:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:59 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477184.3434541, 19dedd10-10f6-46ff-a35e-b80126aa1f53 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 16:59:59 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] VM Stopped (Lifecycle Event)
Jul 27 16:59:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-188f12de-f182-48cb-bb7e-094629a4df1d None None] [instance: 19dedd10-10f6-46ff-a35e-b80126aa1f53] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 16:59:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 16:59:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:22 user nova-compute[71026]: INFO nova.compute.manager [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Unshelving
Jul 27 17:00:22 user nova-compute[71026]: INFO nova.virt.block_device [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Booting with volume c13dde5a-e35c-4c28-9ade-cfff7af5410a at /dev/vdc
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4943a217-7591-44a8-b317-ca59ce06d8b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd036ab-6d00-4b84-aa1f-ef0286e19cf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb35713-9bd6-47e7-a29e-2f5c4c5d6970]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f0c839-d8d9-4f90-b3e9-6e65f14b3617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:00:22 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:00:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d020fd9-356c-4000-bc5e-bb6e8d565de2]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG os_brick.utils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:00:22 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating existing volume attachment record: 8998bd83-6db6-4f6c-abc1-605c5003a28f {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:00:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:00:25 user nova-compute[71026]: INFO nova.compute.manager [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] instance snapshotting
Jul 27 17:00:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Beginning live snapshot process
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.182s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413.delta 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413.delta 1073741824" returned: 0 in 0.058s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 17:00:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 17:00:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 17:00:27 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 17:00:27 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:00:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413.delta /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:27 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413.delta /opt/stack/data/nova/instances/snapshots/tmpif3t2cu7/90ae9ade777d4d4ebb8f7f6f8c041413" returned: 0 in 0.460s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:27 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Snapshot extracted, beginning image upload
Jul 27 17:00:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_requests' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'numa_topology' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:00:29 user nova-compute[71026]: INFO nova.compute.claims [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Claim successful on node user
Jul 27 17:00:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:00:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:29 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Snapshot image upload complete
Jul 27 17:00:29 user nova-compute[71026]: INFO nova.compute.manager [None req-fdb0eb9d-d89c-437d-aa62-af72d049ba89 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Took 4.86 seconds to snapshot the instance on the hypervisor.
Jul 27 17:00:30 user nova-compute[71026]: INFO nova.network.neutron [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating port b22bca0c-a4ec-4455-98b9-a5cac7e2efff with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing instance network info cache due to event network-changed-b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.network.neutron [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:00:31 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Creating image(s)
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG nova.network.neutron [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Refreshing network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.part --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG nova.virt.images [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] b027c33e-ccf6-49cb-a402-02a47d644fb5 was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.part /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updated VIF entry in instance network info cache for port b22bca0c-a4ec-4455-98b9-a5cac7e2efff. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:00:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a765d67f-c30a-487c-92a8-c4665d17148e req-dc0fffc7-f337-4a46-81d1-000661e4a9ee service nova] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.part /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.converted" returned: 0 in 0.537s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.592s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d,backing_fmt=raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d,backing_fmt=raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk 1073741824" returned: 0 in 0.047s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e9d87b1abd81a228e0813a77c4762348cbf4855d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:33 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'migration_context' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Rebasing disk image.
Jul 27 17:00:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 -F raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:35 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 -F raw /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk" returned: 0 in 2.404s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Ensure instance console log exists: /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start _get_guest_xml network_info=[{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6dbac025b7a9e1b0b17f644f155e0134',container_format='bare',created_at=2023-07-27T16:58:30Z,direct_url=<?>,disk_format='qcow2',id=b027c33e-ccf6-49cb-a402-02a47d644fb5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-490787159-shelved',owner='bebe60ded919474b85143cbe6d607ba5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T16:58:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8998bd83-6db6-4f6c-abc1-605c5003a28f', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiXtMpyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e5aa2385-ce14-4055-9aa4-666bbeb33dac', 'attached_at': '', 'detached_at': '', 'volume_id': 'c13dde5a-e35c-4c28-9ade-cfff7af5410a', 'serial': 'c13dde5a-e35c-4c28-9ade-cfff7af5410a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:00:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:00:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6dbac025b7a9e1b0b17f644f155e0134',container_format='bare',created_at=2023-07-27T16:58:30Z,direct_url=<?>,disk_format='qcow2',id=b027c33e-ccf6-49cb-a402-02a47d644fb5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-490787159-shelved',owner='bebe60ded919474b85143cbe6d607ba5',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T16:58:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiXtMpyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:00:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:00:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:00:36 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad545a4-496a-4d46-bc9e-45af456205be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:00:36 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8767a93a-98d2-4a2c-9165-08461c2d8924]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a] added
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5cbce-b558-4f03-9984-3d41ae545d65]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dffc557-4cd3-47e6-b42d-9803df7e7a02]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiXtMpyK {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fiXtMpyK" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192a9e9-8a01-4048-85a5-24f6c3964a91]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fiXtMpyK'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0d0872-8edd-49ab-bc84-053496541f92]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5c962-d44a-4dca-af4d-f1092e173284]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd4913-72f9-40a8-adf8-946c12672309]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260]
Jul 27 17:00:36 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260] successful.
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3938725-9f8c-471c-bf63-0ab9af215ec9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd31891-1b29-4f2a-a039-94462016e137]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:00:36 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:00:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f316d5f-4d0a-4909-8113-5ceeb4483843]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:00:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiXtMpyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23238333738393565', 'path': '/dev/sde'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238333738393565', 'path': '/dev/sde'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='b027c33e-ccf6-49cb-a402-02a47d644fb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-539704832',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:56:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T16:58:34.020516',shelved_host='user',shelved_image_id='b027c33e-ccf6-49cb-a402-02a47d644fb5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_devices' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:00:37 user nova-compute[71026]:   <uuid>e5aa2385-ce14-4055-9aa4-666bbeb33dac</uuid>
Jul 27 17:00:37 user nova-compute[71026]:   <name>instance-00000022</name>
Jul 27 17:00:37 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:00:37 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:00:37 user nova-compute[71026]:   <metadata>
Jul 27 17:00:37 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:00:37 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-490787159</nova:name>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:00:36</nova:creationTime>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:00:37 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:00:37 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:owner>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:user uuid="62e60e4b7b164fc19a1d932799eca227">tempest-AttachVolumeShelveTestJSON-576960083-project-member</nova:user>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:project uuid="bebe60ded919474b85143cbe6d607ba5">tempest-AttachVolumeShelveTestJSON-576960083</nova:project>
Jul 27 17:00:37 user nova-compute[71026]:       </nova:owner>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:root type="image" uuid="b027c33e-ccf6-49cb-a402-02a47d644fb5"/>
Jul 27 17:00:37 user nova-compute[71026]:       <nova:ports>
Jul 27 17:00:37 user nova-compute[71026]:         <nova:port uuid="b22bca0c-a4ec-4455-98b9-a5cac7e2efff">
Jul 27 17:00:37 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 27 17:00:37 user nova-compute[71026]:         </nova:port>
Jul 27 17:00:37 user nova-compute[71026]:       </nova:ports>
Jul 27 17:00:37 user nova-compute[71026]:     </nova:instance>
Jul 27 17:00:37 user nova-compute[71026]:   </metadata>
Jul 27 17:00:37 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:00:37 user nova-compute[71026]:     <system>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="serial">e5aa2385-ce14-4055-9aa4-666bbeb33dac</entry>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="uuid">e5aa2385-ce14-4055-9aa4-666bbeb33dac</entry>
Jul 27 17:00:37 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:00:37 user nova-compute[71026]:     </system>
Jul 27 17:00:37 user nova-compute[71026]:   </sysinfo>
Jul 27 17:00:37 user nova-compute[71026]:   <os>
Jul 27 17:00:37 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:00:37 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:00:37 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:00:37 user nova-compute[71026]:   </os>
Jul 27 17:00:37 user nova-compute[71026]:   <features>
Jul 27 17:00:37 user nova-compute[71026]:     <acpi/>
Jul 27 17:00:37 user nova-compute[71026]:     <apic/>
Jul 27 17:00:37 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:00:37 user nova-compute[71026]:   </features>
Jul 27 17:00:37 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:00:37 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:00:37 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:00:37 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:00:37 user nova-compute[71026]:   </clock>
Jul 27 17:00:37 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:00:37 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:00:37 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:00:37 user nova-compute[71026]:   </cpu>
Jul 27 17:00:37 user nova-compute[71026]:   <devices>
Jul 27 17:00:37 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:00:37 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:00:37 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk"/>
Jul 27 17:00:37 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:00:37 user nova-compute[71026]:     </disk>
Jul 27 17:00:37 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 17:00:37 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:00:37 user nova-compute[71026]:       <source dev="/dev/sde"/>
Jul 27 17:00:37 user nova-compute[71026]:       <target dev="vdc" bus="virtio"/>
Jul 27 17:00:37 user nova-compute[71026]:       <serial>c13dde5a-e35c-4c28-9ade-cfff7af5410a</serial>
Jul 27 17:00:37 user nova-compute[71026]:     </disk>
Jul 27 17:00:37 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:00:37 user nova-compute[71026]:       <mac address="fa:16:3e:1e:a4:02"/>
Jul 27 17:00:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:00:37 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:00:37 user nova-compute[71026]:       <target dev="tapb22bca0c-a4"/>
Jul 27 17:00:37 user nova-compute[71026]:     </interface>
Jul 27 17:00:37 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:00:37 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/console.log" append="off"/>
Jul 27 17:00:37 user nova-compute[71026]:     </serial>
Jul 27 17:00:37 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:00:37 user nova-compute[71026]:     <video>
Jul 27 17:00:37 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:00:37 user nova-compute[71026]:     </video>
Jul 27 17:00:37 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:00:37 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:00:37 user nova-compute[71026]:     </rng>
Jul 27 17:00:37 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:00:37 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:00:37 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:00:37 user nova-compute[71026]:     </memballoon>
Jul 27 17:00:37 user nova-compute[71026]:   </devices>
Jul 27 17:00:37 user nova-compute[71026]: </domain>
Jul 27 17:00:37 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='b027c33e-ccf6-49cb-a402-02a47d644fb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-539704832',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:56:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T16:58:34.020516',shelved_host='user',shelved_image_id='b027c33e-ccf6-49cb-a402-02a47d644fb5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:00:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG os_vif [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb22bca0c-a4, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb22bca0c-a4, col_values=(('external_ids', {'iface-id': 'b22bca0c-a4ec-4455-98b9-a5cac7e2efff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a4:02', 'vm-uuid': 'e5aa2385-ce14-4055-9aa4-666bbeb33dac'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:00:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:37 user nova-compute[71026]: INFO os_vif [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4')
Jul 27 17:00:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No VIF found with MAC fa:16:3e:1e:a4:02, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:38 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:00:39 user nova-compute[71026]: WARNING nova.compute.manager [req-9362d645-e4ef-417d-9840-a4dea0b7ce34 req-b1abda9b-35e6-436e-9858-93be1c6e56b5 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 17:00:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:00:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477241.86454, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:00:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Resumed (Lifecycle Event)
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:00:42 user nova-compute[71026]: WARNING nova.compute.manager [req-5e217b1d-4779-44c1-999b-c24422439be4 req-cdda43d5-a55b-41dd-ad33-d6f53eaec19e service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:00:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:00:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=25.3076171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:00:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance spawned successfully.
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:00:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477241.866484, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:00:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Started (Lifecycle Event)
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:00:42 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 23866140-3332-491e-97e5-fb64f82ae13f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 66a6cab1-92b5-4124-995d-420221399d45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (df003a51-b9f8-417e-bcc9-71861af955a8): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1751}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b29c563b-a7a7-4dcb-b549-c3ac9df33376 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.405s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:00:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:00:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:00:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:00:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:00:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:00:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:01:20 user nova-compute[71026]: INFO nova.compute.claims [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Claim successful on node user
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:01:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:01:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Creating image(s)
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "/opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "/opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "/opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.policy [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7a631743ff94eb39de07ab93dbab277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3900f34346024543a4bc0daaabb71073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk 1073741824" returned: 0 in 0.049s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:01:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Cannot resize image /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lazy-loading 'migration_context' on Instance uuid b03cbd5a-2085-43bb-a295-6aacc0e43dfc {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Ensure instance console log exists: /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Successfully created port: 8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:01:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Successfully updated port: 8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquired lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-changed-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Refreshing instance network info cache due to event network-changed-8cb821e6-be7e-496b-ba75-11a149f88495. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] Acquiring lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Updating instance_info_cache with network_info: [{"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Releasing lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Instance network_info: |[{"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] Acquired lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.neutron [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Refreshing network info cache for port 8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Start _get_guest_xml network_info=[{"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:01:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-891865890',display_name='tempest-VolumesNegativeTest-instance-891865890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-891865890',id=40,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3900f34346024543a4bc0daaabb71073',ramdisk_id='',reservation_id='r-u79y9n20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1377408799',owner_user_name='tempest-VolumesNegativeTest-1377408799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:01:21Z,user_data=None,user_id='d7a631743ff94eb39de07ab93dbab277',uuid=b03cbd5a-2085-43bb-a295-6aacc0e43dfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converting VIF {"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lazy-loading 'pci_devices' on Instance uuid b03cbd5a-2085-43bb-a295-6aacc0e43dfc {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:01:23 user nova-compute[71026]:   <uuid>b03cbd5a-2085-43bb-a295-6aacc0e43dfc</uuid>
Jul 27 17:01:23 user nova-compute[71026]:   <name>instance-00000028</name>
Jul 27 17:01:23 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:01:23 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:01:23 user nova-compute[71026]:   <metadata>
Jul 27 17:01:23 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:01:23 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:name>tempest-VolumesNegativeTest-instance-891865890</nova:name>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:01:23</nova:creationTime>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:01:23 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:01:23 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:owner>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:user uuid="d7a631743ff94eb39de07ab93dbab277">tempest-VolumesNegativeTest-1377408799-project-member</nova:user>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:project uuid="3900f34346024543a4bc0daaabb71073">tempest-VolumesNegativeTest-1377408799</nova:project>
Jul 27 17:01:23 user nova-compute[71026]:       </nova:owner>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:01:23 user nova-compute[71026]:       <nova:ports>
Jul 27 17:01:23 user nova-compute[71026]:         <nova:port uuid="8cb821e6-be7e-496b-ba75-11a149f88495">
Jul 27 17:01:23 user nova-compute[71026]:           <nova:ip type="fixed" address="192.168.233.82" ipVersion="4"/>
Jul 27 17:01:23 user nova-compute[71026]:         </nova:port>
Jul 27 17:01:23 user nova-compute[71026]:       </nova:ports>
Jul 27 17:01:23 user nova-compute[71026]:     </nova:instance>
Jul 27 17:01:23 user nova-compute[71026]:   </metadata>
Jul 27 17:01:23 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:01:23 user nova-compute[71026]:     <system>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="serial">b03cbd5a-2085-43bb-a295-6aacc0e43dfc</entry>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="uuid">b03cbd5a-2085-43bb-a295-6aacc0e43dfc</entry>
Jul 27 17:01:23 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:01:23 user nova-compute[71026]:     </system>
Jul 27 17:01:23 user nova-compute[71026]:   </sysinfo>
Jul 27 17:01:23 user nova-compute[71026]:   <os>
Jul 27 17:01:23 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:01:23 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:01:23 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:01:23 user nova-compute[71026]:   </os>
Jul 27 17:01:23 user nova-compute[71026]:   <features>
Jul 27 17:01:23 user nova-compute[71026]:     <acpi/>
Jul 27 17:01:23 user nova-compute[71026]:     <apic/>
Jul 27 17:01:23 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:01:23 user nova-compute[71026]:   </features>
Jul 27 17:01:23 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:01:23 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:01:23 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:01:23 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:01:23 user nova-compute[71026]:   </clock>
Jul 27 17:01:23 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:01:23 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:01:23 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:01:23 user nova-compute[71026]:   </cpu>
Jul 27 17:01:23 user nova-compute[71026]:   <devices>
Jul 27 17:01:23 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:01:23 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:01:23 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk"/>
Jul 27 17:01:23 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:01:23 user nova-compute[71026]:     </disk>
Jul 27 17:01:23 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:01:23 user nova-compute[71026]:       <mac address="fa:16:3e:c0:ff:20"/>
Jul 27 17:01:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:01:23 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:01:23 user nova-compute[71026]:       <target dev="tap8cb821e6-be"/>
Jul 27 17:01:23 user nova-compute[71026]:     </interface>
Jul 27 17:01:23 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:01:23 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/console.log" append="off"/>
Jul 27 17:01:23 user nova-compute[71026]:     </serial>
Jul 27 17:01:23 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:01:23 user nova-compute[71026]:     <video>
Jul 27 17:01:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:01:23 user nova-compute[71026]:     </video>
Jul 27 17:01:23 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:01:23 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:01:23 user nova-compute[71026]:     </rng>
Jul 27 17:01:23 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:01:23 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:01:23 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:01:23 user nova-compute[71026]:     </memballoon>
Jul 27 17:01:23 user nova-compute[71026]:   </devices>
Jul 27 17:01:23 user nova-compute[71026]: </domain>
Jul 27 17:01:23 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-891865890',display_name='tempest-VolumesNegativeTest-instance-891865890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-891865890',id=40,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3900f34346024543a4bc0daaabb71073',ramdisk_id='',reservation_id='r-u79y9n20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1377408799',owner_user_name='tempest-VolumesNegativeTest-1377408799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:01:21Z,user_data=None,user_id='d7a631743ff94eb39de07ab93dbab277',uuid=b03cbd5a-2085-43bb-a295-6aacc0e43dfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converting VIF {"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG os_vif [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb821e6-be, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8cb821e6-be, col_values=(('external_ids', {'iface-id': '8cb821e6-be7e-496b-ba75-11a149f88495', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ff:20', 'vm-uuid': 'b03cbd5a-2085-43bb-a295-6aacc0e43dfc'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:23 user nova-compute[71026]: INFO os_vif [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be')
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:01:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] No VIF found with MAC fa:16:3e:c0:ff:20, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:01:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Updated VIF entry in instance network info cache for port 8cb821e6-be7e-496b-ba75-11a149f88495. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:01:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Updating instance_info_cache with network_info: [{"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e9d71b00-4fa6-40b9-9245-3d6e141073aa req-2afda347-1361-4986-b12d-4845931878da service nova] Releasing lock "refresh_cache-b03cbd5a-2085-43bb-a295-6aacc0e43dfc" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] No waiting events found dispatching network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:25 user nova-compute[71026]: WARNING nova.compute.manager [req-884c9135-7fb0-46d4-a288-f4fed1ac26c7 req-a9037c57-94ec-4b9f-807f-26d798a818d6 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received unexpected event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 for instance with vm_state building and task_state spawning.
Jul 27 17:01:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing instance network info cache due to event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] Acquiring lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] Acquired lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing network info cache for port 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:26 user nova-compute[71026]: INFO nova.compute.manager [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Attaching volume 29740556-d3c3-4b85-b463-489cbbc7665f to /dev/vdb
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG nova.network.neutron [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updated VIF entry in instance network info cache for port 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG nova.network.neutron [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acfd67b-efa0-40cb-ac78-1d4f0fa1444b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-593a6bc8-61ca-476c-a418-20fa3c71a581 req-6460ee54-d0b9-4d2b-afa3-36b15b7b0a4a service nova] Releasing lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b2f80b-8a09-4900-97c8-e3fa149531d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d111c2-6c23-4d60-85e1-6192e9fab1f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a15599-0dda-4952-8b7a-d4f6647456fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:01:26 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:01:26 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb401c1-c3f3-4d39-b238-36664704bb8e]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG os_brick.utils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:26 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating existing volume attachment record: 9a230460-c41a-4989-ae6d-39e2b830784b {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477287.404817, b03cbd5a-2085-43bb-a295-6aacc0e43dfc => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] VM Resumed (Lifecycle Event)
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Instance spawned successfully.
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477287.4076705, b03cbd5a-2085-43bb-a295-6aacc0e43dfc => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] VM Started (Lifecycle Event)
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] No waiting events found dispatching network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:27 user nova-compute[71026]: WARNING nova.compute.manager [req-58ee30f5-5d32-4ebf-b0c8-ed028eb96b53 req-b31ee097-d28c-4039-ba25-947b87e12a5b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received unexpected event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 for instance with vm_state building and task_state spawning.
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Took 6.18 seconds to spawn the instance on the hypervisor.
Jul 27 17:01:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:27 user nova-compute[71026]: INFO nova.compute.manager [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Took 6.84 seconds to build instance.
Jul 27 17:01:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-76a49596-d3cb-4303-803a-b8479ff3dac9 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:28 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:31 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing instance network info cache due to event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] Acquiring lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] Acquired lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:01:32 user nova-compute[71026]: INFO nova.compute.claims [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Claim successful on node user
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updated VIF entry in instance network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating instance_info_cache with network_info: [{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-85ef27e0-9114-4b5b-8fce-bfe44a2dbe57 req-5a4826ed-64b4-4248-b2d1-b143db49067e service nova] Releasing lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:01:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:01:32 user nova-compute[71026]: INFO nova.virt.block_device [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Booting with volume-backed-image 25ab5798-ce67-493f-a351-9c5665bf837e at /dev/vda
Jul 27 17:01:32 user nova-compute[71026]: DEBUG nova.policy [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c742ca26757400288ef69caac251d91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cbbd8fb9af44b38b4c48be901f137a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing instance network info cache due to event network-changed-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] Acquiring lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] Acquired lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Refreshing network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:33 user nova-compute[71026]: INFO nova.compute.manager [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Terminating instance
Jul 27 17:01:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Successfully created port: c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-unplugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] No waiting events found dispatching network-vif-unplugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-c050ca54-60d4-4764-a45c-5040aa34e74f req-9c62f973-2d73-4670-8aec-9c49dec1b0d1 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-unplugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updated VIF entry in instance network info cache for port 9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating instance_info_cache with network_info: [{"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2cfa2f6c-2731-43fa-b7af-c434f2b5471e req-64825497-09d9-408e-834e-53f06a00bff9 service nova] Releasing lock "refresh_cache-66a6cab1-92b5-4124-995d-420221399d45" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLfmxUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:34 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:01:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Instance destroyed successfully.
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid 66a6cab1-92b5-4124-995d-420221399d45 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85234d4-be61-442a-aa07-bb79b287e5d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:01:34 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1093725815',display_name='tempest-TestVolumeBootPattern-server-1093725815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1093725815',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:59:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-32awrx60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:59:53Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=66a6cab1-92b5-4124-995d-420221399d45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "address": "fa:16:3e:9a:15:c9", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d49bd9e-67", "ovs_interfaceid": "9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_vif [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d49bd9e-67, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:01:34 user nova-compute[71026]: INFO os_vif [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:15:c9,bridge_name='br-int',has_traffic_filtering=True,id=9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d49bd9e-67')
Jul 27 17:01:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxMdwGoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c50e0-67c5-4952-9eef-366c30f22fb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f] added
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[700841ac-6da3-40ec-ad2a-aea10ab9083d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50d813b-dee3-4c57-b78e-dabcbe99ca7f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PoLfmxUs {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PoLfmxUs" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[382750cf-5e41-4161-86a3-5380cb54cc6a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PoLfmxUs'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2190e691-09dc-4333-823c-f9f1c7e6a61e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05607271-c535-49f0-8b73-9ff2c3c9a8d5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b7463-9927-4087-a45f-2fa98ea17611]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260]
Jul 27 17:01:34 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260] successful.
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb8adf-1266-41e7-b604-c8d8997e3f42]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590cc32-60b4-4e40-9473-c73148cdc53d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:34 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9bdd2a-f281-4ac5-af82-0c67255dfd5e]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:01:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLfmxUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Successfully updated port: c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-changed-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Refreshing instance network info cache due to event network-changed-c051e627-8c47-4070-9b5c-f5f50420713a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] Acquiring lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance network_info: |[{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] Acquired lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Refreshing network info cache for port c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26532356632313033', 'path': '/dev/sdf'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532356632313033', 'path': '/dev/sdf'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.354s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.objects.instance [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68392b8-3889-4374-a4ad-d6238e1406a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:01:35 user nova-compute[71026]: No targets found.
Jul 27 17:01:35 user nova-compute[71026]: iSNS:
Jul 27 17:01:35 user nova-compute[71026]: No targets found.
Jul 27 17:01:35 user nova-compute[71026]: STATIC:
Jul 27 17:01:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851
Jul 27 17:01:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a
Jul 27 17:01:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f
Jul 27 17:01:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea
Jul 27 17:01:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:35 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:01:35 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:35 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:35 user nova-compute[71026]: FIRMWARE:
Jul 27 17:01:35 user nova-compute[71026]: No targets found.
Jul 27 17:01:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:01:35 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:01:35 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:01:35 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:01:35 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 17:01:35 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:01:35 user nova-compute[71026]:   <serial>29740556-d3c3-4b85-b463-489cbbc7665f</serial>
Jul 27 17:01:35 user nova-compute[71026]: </disk>
Jul 27 17:01:35 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dbf6e7-a3e3-41ba-bf73-f5ce9e8d68e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a44ec-c910-4bad-bb29-00d64f42501f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:35 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308867ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:01:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b84fb7-f90c-4e3b-9d97-5acef63a9ee2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f713c7f-5f62-4ac8-99d9-16d2ef1e2bfc]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a9a8a1-2ed0-49e1-b264-e3f648bc9433]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] Lock "66a6cab1-92b5-4124-995d-420221399d45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] No waiting events found dispatching network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:36 user nova-compute[71026]: WARNING nova.compute.manager [req-95874b17-1818-4752-bdb9-7542cf23db4c req-039091fa-1828-4970-8de9-76cf6c5f753b service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received unexpected event network-vif-plugged-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 for instance with vm_state active and task_state deleting.
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updated VIF entry in instance network info cache for port c051e627-8c47-4070-9b5c-f5f50420713a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ecf3d-22f7-4ebe-9ada-052cee95ac59]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d8911313-c7f3-4649-8b62-c011bfb25989 req-c2106868-90df-4308-8f69-72db704ab4f3 service nova] Releasing lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d559d5-fc35-4682-b371-a73d390ab499]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8fd374-be3b-497e-b544-9a2bf45d547a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260]
Jul 27 17:01:36 user nova-compute[71026]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851, portal: 172.16.0.220,3260] successful.
Jul 27 17:01:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33929e7d-57fe-43ec-9233-149d882db851 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dbf59e-2c52-4bc8-9ff8-07a345fde78a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (1814ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:01:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Deleting instance files /opt/stack/data/nova/instances/66a6cab1-92b5-4124-995d-420221399d45_del
Jul 27 17:01:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Deletion of /opt/stack/data/nova/instances/66a6cab1-92b5-4124-995d-420221399d45_del complete
Jul 27 17:01:36 user nova-compute[71026]: WARNING nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 23866140-3332-491e-97e5-fb64f82ae13f {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 4a661cd6-8dfb-4266-a5ca-cea210c9080a {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 66a6cab1-92b5-4124-995d-420221399d45 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid b03cbd5a-2085-43bb-a295-6aacc0e43dfc {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "23866140-3332-491e-97e5-fb64f82ae13f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "66a6cab1-92b5-4124-995d-420221399d45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No VIF found with MAC fa:16:3e:a1:2f:47, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: INFO nova.compute.manager [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Took 2.74 seconds to destroy the instance on the hypervisor.
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "23866140-3332-491e-97e5-fb64f82ae13f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-87b8fb6e-37d5-4505-a97c-a4806fdec7b6 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.109s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.213s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:36 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:01:36 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Took 0.56 seconds to deallocate network for instance.
Jul 27 17:01:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-606f3f9a-b45d-4639-b736-50a11da74e2f req-b90255c6-d6cf-4e39-8827-d475313f73e0 service nova] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Received event network-vif-deleted-9d49bd9e-6721-49f7-ba97-8a8ca9fe04e9 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:37 user nova-compute[71026]: INFO nova.compute.manager [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Took 0.85 seconds to detach 1 volumes for instance.
Jul 27 17:01:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:38 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance 66a6cab1-92b5-4124-995d-420221399d45
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-55c671cb-f256-4950-9c00-64c31549795b tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "66a6cab1-92b5-4124-995d-420221399d45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.785s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "66a6cab1-92b5-4124-995d-420221399d45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.094s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:38 user nova-compute[71026]: INFO nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "66a6cab1-92b5-4124-995d-420221399d45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c34dd2d-0e31-40cb-8027-1770184d680c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7deca4-644b-4ff9-ae45-37731fbaaea5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7c1ca-488c-4520-b39b-881b09c44dcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58382100-fc95-4ad3-9f85-aa5faa908558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:01:38 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[141dad4a-35d6-4e01-b42f-2510a31c2aef]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating existing volume attachment record: 04b7b900-cea3-4ee5-866a-5d143c94a69c {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:38 user nova-compute[71026]: INFO nova.compute.manager [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Detaching volume 29740556-d3c3-4b85-b463-489cbbc7665f
Jul 27 17:01:39 user nova-compute[71026]: INFO nova.virt.block_device [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Attempting to driver detach volume 29740556-d3c3-4b85-b463-489cbbc7665f from mountpoint /dev/vdb
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Attempting to detach device vdb from instance 6e950d30-892f-471b-82d2-f435da94a63d from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:01:39 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:01:39 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 17:01:39 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:01:39 user nova-compute[71026]:   <serial>29740556-d3c3-4b85-b463-489cbbc7665f</serial>
Jul 27 17:01:39 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:01:39 user nova-compute[71026]: </disk>
Jul 27 17:01:39 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:01:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully detached device vdb from instance 6e950d30-892f-471b-82d2-f435da94a63d from the persistent domain config.
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e950d30-892f-471b-82d2-f435da94a63d from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:01:39 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:01:39 user nova-compute[71026]:   <source dev="/dev/sdf"/>
Jul 27 17:01:39 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:01:39 user nova-compute[71026]:   <serial>29740556-d3c3-4b85-b463-489cbbc7665f</serial>
Jul 27 17:01:39 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:01:39 user nova-compute[71026]: </disk>
Jul 27 17:01:39 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477299.4922316, 6e950d30-892f-471b-82d2-f435da94a63d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:01:39 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully detached device vdb from instance 6e950d30-892f-471b-82d2-f435da94a63d from the live domain config.
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PoLfmxUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:39 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[11896703-992c-4740-b427-d3a7bc8d3115]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:01:39 user nova-compute[71026]: No targets found.
Jul 27 17:01:39 user nova-compute[71026]: iSNS:
Jul 27 17:01:39 user nova-compute[71026]: No targets found.
Jul 27 17:01:39 user nova-compute[71026]: STATIC:
Jul 27 17:01:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a
Jul 27 17:01:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f
Jul 27 17:01:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea
Jul 27 17:01:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:39 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:01:39 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:01:39 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:01:39 user nova-compute[71026]: FIRMWARE:
Jul 27 17:01:39 user nova-compute[71026]: No targets found.
Jul 27 17:01:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:01:39 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:01:39 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083b5e4-b82c-42b5-92c9-1d86b479176f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c366645-b2db-4f85-9359-621e0afee9d1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:39 user nova-compute[71026]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f (non-flash)
Jul 27 17:01:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a81ac820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f'): ({'sdf'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Removing single pathed devices sdf {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39299dae-6fb0-49f9-8322-88912db1fe0d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef7246-b3cb-4762-b965-1a36de751f98]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flushing IO for device /dev/sdf {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[608b412f-b51e-40c9-800e-0ba38d4d25e2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7887afaa-8fbe-4f56-9e9d-cbcd88447919]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] SCSI volumes sdf have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5e494-ed34-4fd4-9d7a-f1857e7b220d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[94de29c5-ba27-4891-84e4-ae2e7954ba1f]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260]
Jul 27 17:01:39 user nova-compute[71026]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f, portal: 172.16.0.220,3260] successful.
Jul 27 17:01:39 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29740556-d3c3-4b85-b463-489cbbc7665f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b1ec1-935e-434a-8e32-48b35de07cb9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== disconnect_volume: return (306ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-b0810ee0-32a9-46b8-8157-4d3882870085 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:01:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.400474548339844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 23866140-3332-491e-97e5-fb64f82ae13f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e5aa2385-ce14-4055-9aa4-666bbeb33dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b03cbd5a-2085-43bb-a295-6aacc0e43dfc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:01:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:01:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Creating image(s)
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Did not create local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Ensure instance console log exists: /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start _get_guest_xml network_info=[{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '04b7b900-cea3-4ee5-866a-5d143c94a69c', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d0485a3-06b6-4f95-972a-fadb9f03d235', 'attached_at': '', 'detached_at': '', 'volume_id': '58334e63-fa95-4139-8366-e6c3bfbebfa9', 'serial': '58334e63-fa95-4139-8366-e6c3bfbebfa9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:01:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:01:46 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:46 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:01:46 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7150ef-b5b6-4f9b-bf1c-81802b35c814]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:01:46 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e569fa6-8c47-4a38-b3e9-17312daf48f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9] added
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6cd35c-1885-40d3-8645-3025e1c6007d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301427c-52b0-40ac-a0a4-d5acb33af5f4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzYTZrD {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzYTZrD" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3d3210-fa17-483f-a8dc-9736cee41da0]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbzYTZrD'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a955d4-994f-470d-92ac-a92b86efec2b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1000f2-757d-479d-af08-efed7ecfbfc0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5bca1d-024a-4ed2-9ece-f86fcdac7259]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260]
Jul 27 17:01:46 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260] successful.
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae011f-9b4c-45da-b52d-2abf75f0a1c3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717130a-e6d2-4bf6-b5d6-4d2c17f3b42a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:01:46 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:01:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe62574-d96b-4084-a66e-2c3250683e2b]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:01:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23836396361333735', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836396361333735', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818328519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818328519',id=41,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-702fmsjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:01:33Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=1d0485a3-06b6-4f95-972a-fadb9f03d235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:01:47 user nova-compute[71026]:   <uuid>1d0485a3-06b6-4f95-972a-fadb9f03d235</uuid>
Jul 27 17:01:47 user nova-compute[71026]:   <name>instance-00000029</name>
Jul 27 17:01:47 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:01:47 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:01:47 user nova-compute[71026]:   <metadata>
Jul 27 17:01:47 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:01:47 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1818328519</nova:name>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:01:46</nova:creationTime>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:01:47 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:01:47 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:owner>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 17:01:47 user nova-compute[71026]:       </nova:owner>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:01:47 user nova-compute[71026]:       <nova:ports>
Jul 27 17:01:47 user nova-compute[71026]:         <nova:port uuid="c051e627-8c47-4070-9b5c-f5f50420713a">
Jul 27 17:01:47 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:01:47 user nova-compute[71026]:         </nova:port>
Jul 27 17:01:47 user nova-compute[71026]:       </nova:ports>
Jul 27 17:01:47 user nova-compute[71026]:     </nova:instance>
Jul 27 17:01:47 user nova-compute[71026]:   </metadata>
Jul 27 17:01:47 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:01:47 user nova-compute[71026]:     <system>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="serial">1d0485a3-06b6-4f95-972a-fadb9f03d235</entry>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="uuid">1d0485a3-06b6-4f95-972a-fadb9f03d235</entry>
Jul 27 17:01:47 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:01:47 user nova-compute[71026]:     </system>
Jul 27 17:01:47 user nova-compute[71026]:   </sysinfo>
Jul 27 17:01:47 user nova-compute[71026]:   <os>
Jul 27 17:01:47 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:01:47 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:01:47 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:01:47 user nova-compute[71026]:   </os>
Jul 27 17:01:47 user nova-compute[71026]:   <features>
Jul 27 17:01:47 user nova-compute[71026]:     <acpi/>
Jul 27 17:01:47 user nova-compute[71026]:     <apic/>
Jul 27 17:01:47 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:01:47 user nova-compute[71026]:   </features>
Jul 27 17:01:47 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:01:47 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:01:47 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:01:47 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:01:47 user nova-compute[71026]:   </clock>
Jul 27 17:01:47 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:01:47 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:01:47 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:01:47 user nova-compute[71026]:   </cpu>
Jul 27 17:01:47 user nova-compute[71026]:   <devices>
Jul 27 17:01:47 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 17:01:47 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:01:47 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 17:01:47 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:01:47 user nova-compute[71026]:       <serial>58334e63-fa95-4139-8366-e6c3bfbebfa9</serial>
Jul 27 17:01:47 user nova-compute[71026]:     </disk>
Jul 27 17:01:47 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:01:47 user nova-compute[71026]:       <mac address="fa:16:3e:86:76:3b"/>
Jul 27 17:01:47 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:01:47 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:01:47 user nova-compute[71026]:       <target dev="tapc051e627-8c"/>
Jul 27 17:01:47 user nova-compute[71026]:     </interface>
Jul 27 17:01:47 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:01:47 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/console.log" append="off"/>
Jul 27 17:01:47 user nova-compute[71026]:     </serial>
Jul 27 17:01:47 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:01:47 user nova-compute[71026]:     <video>
Jul 27 17:01:47 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:01:47 user nova-compute[71026]:     </video>
Jul 27 17:01:47 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:01:47 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:01:47 user nova-compute[71026]:     </rng>
Jul 27 17:01:47 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:01:47 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:01:47 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:01:47 user nova-compute[71026]:     </memballoon>
Jul 27 17:01:47 user nova-compute[71026]:   </devices>
Jul 27 17:01:47 user nova-compute[71026]: </domain>
Jul 27 17:01:47 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818328519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818328519',id=41,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-702fmsjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:01:33Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=1d0485a3-06b6-4f95-972a-fadb9f03d235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG os_vif [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc051e627-8c, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc051e627-8c, col_values=(('external_ids', {'iface-id': 'c051e627-8c47-4070-9b5c-f5f50420713a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:76:3b', 'vm-uuid': '1d0485a3-06b6-4f95-972a-fadb9f03d235'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:47 user nova-compute[71026]: INFO os_vif [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c')
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:01:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:86:76:3b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:01:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:49 user nova-compute[71026]: WARNING nova.compute.manager [req-ac39fb35-2091-4ef6-90ac-a4a141953516 req-7a65d347-74e6-4576-a335-163829d54fa4 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state building and task_state spawning.
Jul 27 17:01:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477294.4090347, 66a6cab1-92b5-4124-995d-420221399d45 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:01:49 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 66a6cab1-92b5-4124-995d-420221399d45] VM Stopped (Lifecycle Event)
Jul 27 17:01:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5dfc8e0d-c926-44f7-8156-cf273e57bf83 None None] [instance: 66a6cab1-92b5-4124-995d-420221399d45] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477310.8879092, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Resumed (Lifecycle Event)
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance spawned successfully.
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477310.8890326, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Started (Lifecycle Event)
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:01:50 user nova-compute[71026]: INFO nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Took 4.94 seconds to spawn the instance on the hypervisor.
Jul 27 17:01:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:01:51 user nova-compute[71026]: WARNING nova.compute.manager [req-ab237ee7-9205-46eb-abd7-15a6e14ce03d req-1d38e56a-4a6d-4c7a-a6e4-994650e9958c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state building and task_state spawning.
Jul 27 17:01:51 user nova-compute[71026]: INFO nova.compute.manager [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Took 19.24 seconds to build instance.
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f20acfc4-90c3-4e66-aaf8-547b9a42fbb8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.330s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.768s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:01:51 user nova-compute[71026]: INFO nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Jul 27 17:01:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:01:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:01:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:13 user nova-compute[71026]: INFO nova.compute.manager [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Detaching volume c13dde5a-e35c-4c28-9ade-cfff7af5410a
Jul 27 17:02:13 user nova-compute[71026]: INFO nova.virt.block_device [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Attempting to driver detach volume c13dde5a-e35c-4c28-9ade-cfff7af5410a from mountpoint /dev/vdc
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Attempting to detach device vdc from instance e5aa2385-ce14-4055-9aa4-666bbeb33dac from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:02:13 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:02:13 user nova-compute[71026]:   <source dev="/dev/sde"/>
Jul 27 17:02:13 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 17:02:13 user nova-compute[71026]:   <serial>c13dde5a-e35c-4c28-9ade-cfff7af5410a</serial>
Jul 27 17:02:13 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 17:02:13 user nova-compute[71026]: </disk>
Jul 27 17:02:13 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:02:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully detached device vdc from instance e5aa2385-ce14-4055-9aa4-666bbeb33dac from the persistent domain config.
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e5aa2385-ce14-4055-9aa4-666bbeb33dac from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:02:13 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:02:13 user nova-compute[71026]:   <source dev="/dev/sde"/>
Jul 27 17:02:13 user nova-compute[71026]:   <target dev="vdc" bus="virtio"/>
Jul 27 17:02:13 user nova-compute[71026]:   <serial>c13dde5a-e35c-4c28-9ade-cfff7af5410a</serial>
Jul 27 17:02:13 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 17:02:13 user nova-compute[71026]: </disk>
Jul 27 17:02:13 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477333.5622501, e5aa2385-ce14-4055-9aa4-666bbeb33dac => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:02:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully detached device vdc from instance e5aa2385-ce14-4055-9aa4-666bbeb33dac from the live domain config.
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fiXtMpyK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:02:13 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f33aa2-8f65-465b-ab11-4c3c749b09d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:02:13 user nova-compute[71026]: No targets found.
Jul 27 17:02:13 user nova-compute[71026]: iSNS:
Jul 27 17:02:13 user nova-compute[71026]: No targets found.
Jul 27 17:02:13 user nova-compute[71026]: STATIC:
Jul 27 17:02:13 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9
Jul 27 17:02:13 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:13 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:13 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a
Jul 27 17:02:13 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:13 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:13 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea
Jul 27 17:02:13 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:13 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:13 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:02:13 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:13 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:13 user nova-compute[71026]: FIRMWARE:
Jul 27 17:02:13 user nova-compute[71026]: No targets found.
Jul 27 17:02:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:02:13 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:02:13 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af8e692-be70-4cbd-ab9e-9b25eb307075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172ff1a-e87c-418f-ba2e-1f54728f98c9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:02:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a (non-flash)
Jul 27 17:02:13 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:02:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30b74b1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a'): ({'sde'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Removing single pathed devices sde {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac35552-bd8b-4096-bdc9-3681887ff2bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed06e7-bc08-4205-85ee-61c30a157d50]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flushing IO for device /dev/sde {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1762bcb-386b-416e-be8d-224f1dea3d4a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bbf4e3-671c-4098-8e27-77c9f601a20b]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] SCSI volumes sde have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d84224e-9d01-4723-bf05-0230ae5e4c85]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabb495-cce4-4717-8293-f0dec7150d66]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260]
Jul 27 17:02:13 user nova-compute[71026]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a, portal: 172.16.0.220,3260] successful.
Jul 27 17:02:13 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c13dde5a-e35c-4c28-9ade-cfff7af5410a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f68ade-baf7-4695-8d0f-100e8aaf4ddd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] <== disconnect_volume: return (313ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:02:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:02:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'flavor' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:02:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-bf946278-c2f9-4a7e-b9f8-6fd52937a842 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing instance network info cache due to event network-changed-f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] Acquiring lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] Acquired lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Refreshing network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:33 user nova-compute[71026]: INFO nova.compute.manager [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Terminating instance
Jul 27 17:02:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updated VIF entry in instance network info cache for port f7038f1e-dca3-4f75-b20b-6485e192bf66. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [{"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-009e475d-7ea1-4b46-b096-78b3da2cb202 req-578bc002-facc-4c8e-9777-7cc44f108899 service nova] Releasing lock "refresh_cache-23866140-3332-491e-97e5-fb64f82ae13f" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:02:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Instance destroyed successfully.
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lazy-loading 'resources' on Instance uuid 23866140-3332-491e-97e5-fb64f82ae13f {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-328384011',display_name='tempest-TestVolumeBootPattern-server-328384011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-328384011',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtI0QAkc5CRJV+0XrCD8mBrdYPSYgE971K5JXXZ0+xsSwdBvhx5Ht/oSZUjmlvZK4NKS4Fzt274b+7ZbqumLAin7zH/yfcZ1PwmW5/yZCgLKUAXU+aIWF8pW37VHxDTvw==',key_name='tempest-TestVolumeBootPattern-1903389877',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3985a0dd491c44958ba564c9c8ef6e4f',ramdisk_id='',reservation_id='r-98jrvakd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2066891657',owner_user_name='tempest-TestVolumeBootPattern-2066891657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:57:48Z,user_data=None,user_id='b6fe5c1c7f7f45299502eb927269a7eb',uuid=23866140-3332-491e-97e5-fb64f82ae13f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converting VIF {"id": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "address": "fa:16:3e:d5:fb:5f", "network": {"id": "8ab24a57-c214-4571-9baa-7b0c44c470e6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1404968058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3985a0dd491c44958ba564c9c8ef6e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7038f1e-dc", "ovs_interfaceid": "f7038f1e-dca3-4f75-b20b-6485e192bf66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_vif [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7038f1e-dc, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:02:34 user nova-compute[71026]: INFO os_vif [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:fb:5f,bridge_name='br-int',has_traffic_filtering=True,id=f7038f1e-dca3-4f75-b20b-6485e192bf66,network=Network(8ab24a57-c214-4571-9baa-7b0c44c470e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7038f1e-dc')
Jul 27 17:02:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mIXsEyBR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:02:34 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b394e1f6-796f-497c-bb47-285befb4e15a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:02:34 user nova-compute[71026]: No targets found.
Jul 27 17:02:34 user nova-compute[71026]: iSNS:
Jul 27 17:02:34 user nova-compute[71026]: No targets found.
Jul 27 17:02:34 user nova-compute[71026]: STATIC:
Jul 27 17:02:34 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9
Jul 27 17:02:34 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:34 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:34 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea
Jul 27 17:02:34 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:34 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:34 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:02:34 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:02:34 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:02:34 user nova-compute[71026]: FIRMWARE:
Jul 27 17:02:34 user nova-compute[71026]: No targets found.
Jul 27 17:02:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:02:34 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:02:34 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b861707-eb0e-4ec2-ad3a-ca2ad32986b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b69ed-4443-43cb-8543-b4d1d776dea2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:02:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:02:34 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:02:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:02:34 user nova-compute[71026]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea (non-flash)
Jul 27 17:02:34 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:02:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308867b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:02:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[933bcdeb-3f58-446a-bf8a-762d39afe996]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e5ca32-4e66-4b2a-ba13-360893b02b12]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[637788af-d78c-487a-a04d-a4e95c09a8cf]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[db924ff0-6c73-4d4c-ac5e-ab7dc313ed6b]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO55004dd1-c711f512daf98138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_55004dd1', '/dev/disk/by-id/scsi-26337313166353132') {{(pid=82023) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa276a0-f674-471d-abc7-1db2ea8912f6]: (4, None) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26bbed6-9782-4b12-8b93-22a523b35471]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8df26d-603f-4cd5-9485-da903d6cc247]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260]
Jul 27 17:02:35 user nova-compute[71026]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea, portal: 172.16.0.220,3260] successful.
Jul 27 17:02:35 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf60fe-05fc-4be0-9628-ed934f1ab1ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bfca0d-6a5e-45b1-b2b0-56996104c2aa]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] <== disconnect_volume: return (332ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Deleting instance files /opt/stack/data/nova/instances/23866140-3332-491e-97e5-fb64f82ae13f_del
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Deletion of /opt/stack/data/nova/instances/23866140-3332-491e-97e5-fb64f82ae13f_del complete
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.compute.manager [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Took 1.42 seconds to destroy the instance on the hypervisor.
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.compute.manager [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] instance snapshotting
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Beginning live snapshot process
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-unplugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] No waiting events found dispatching network-vif-unplugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-unplugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Acquiring lock "23866140-3332-491e-97e5-fb64f82ae13f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] Lock "23866140-3332-491e-97e5-fb64f82ae13f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] No waiting events found dispatching network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:02:35 user nova-compute[71026]: WARNING nova.compute.manager [req-dbb4ec05-2cde-4750-9991-58bc1b1e31a8 req-c18faa39-34ea-4243-8954-fb57de6f6f2c service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received unexpected event network-vif-plugged-f7038f1e-dca3-4f75-b20b-6485e192bf66 for instance with vm_state active and task_state deleting.
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json -f qcow2 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-0a431a54-a88c-46b1-819f-df45c6ba7235 req-d4e09eff-8469-4b64-bc83-9f26c0b8cab6 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Received event network-vif-deleted-f7038f1e-dca3-4f75-b20b-6485e192bf66 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.compute.manager [req-0a431a54-a88c-46b1-819f-df45c6ba7235 req-d4e09eff-8469-4b64-bc83-9f26c0b8cab6 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Neutron deleted interface f7038f1e-dca3-4f75-b20b-6485e192bf66; detaching it from the instance and deleting it from the info cache
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.network.neutron [req-0a431a54-a88c-46b1-819f-df45c6ba7235 req-d4e09eff-8469-4b64-bc83-9f26c0b8cab6 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:35 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Took 0.64 seconds to deallocate network for instance.
Jul 27 17:02:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-0a431a54-a88c-46b1-819f-df45c6ba7235 req-d4e09eff-8469-4b64-bc83-9f26c0b8cab6 service nova] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Detach interface failed, port_id=f7038f1e-dca3-4f75-b20b-6485e192bf66, reason: Instance 23866140-3332-491e-97e5-fb64f82ae13f could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:35 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b.delta 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b.delta 1073741824" returned: 0 in 0.056s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:02:36 user nova-compute[71026]: INFO nova.compute.manager [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Took 0.81 seconds to detach 1 volumes for instance.
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] COPY block job progress, current cursor: 196608 final cursor: 75563008 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [{"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-e5aa2385-ce14-4055-9aa4-666bbeb33dac" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=71026) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 27 17:02:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 27 17:02:37 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Deleted allocations for instance 23866140-3332-491e-97e5-fb64f82ae13f
Jul 27 17:02:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5ed0c3e0-d64b-4d3a-85de-0cf1e82807a7 tempest-TestVolumeBootPattern-2066891657 tempest-TestVolumeBootPattern-2066891657-project-member] Lock "23866140-3332-491e-97e5-fb64f82ae13f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.719s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:02:37 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b.delta /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b.delta /opt/stack/data/nova/instances/snapshots/tmpjlqd6a30/dcd2f2553017442e94be64e4ff25709b" returned: 0 in 0.732s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Snapshot extracted, beginning image upload
Jul 27 17:02:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:02:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Snapshot image upload complete
Jul 27 17:02:41 user nova-compute[71026]: INFO nova.compute.manager [None req-d3217874-23b0-40b8-9dc6-0607525c39de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Took 5.64 seconds to snapshot the instance on the hypervisor.
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:02:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:02:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=25.306121826171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance e5aa2385-ce14-4055-9aa4-666bbeb33dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance b03cbd5a-2085-43bb-a295-6aacc0e43dfc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:02:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:43 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:02:43 user nova-compute[71026]: INFO nova.compute.claims [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Claim successful on node user
Jul 27 17:02:43 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:02:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.policy [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '914c6d75846846a2b944bfb6111f0341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453f1bd5d8b347be913fe262b31a1c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:02:44 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Creating image(s)
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "/opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "/opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Successfully created port: 06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.part --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG nova.virt.images [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] f5b65ec7-8ff7-47f2-aebe-978650c0072c was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.part /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.part /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.converted" returned: 0 in 0.245s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.587s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Successfully updated port: 06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquired lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-changed-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing instance network info cache due to event network-changed-06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] Acquiring lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795,backing_fmt=raw /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795,backing_fmt=raw /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk 1073741824" returned: 0 in 0.051s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'migration_context' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Ensure instance console log exists: /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating instance_info_cache with network_info: [{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Releasing lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Instance network_info: |[{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] Acquired lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing network info cache for port 06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Start _get_guest_xml network_info=[{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fd4cf0c00155b1c8d0fe6f6046716517',container_format='bare',created_at=2023-07-27T17:02:35Z,direct_url=<?>,disk_format='qcow2',id=f5b65ec7-8ff7-47f2-aebe-978650c0072c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-905694853',owner='453f1bd5d8b347be913fe262b31a1c66',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T17:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'f5b65ec7-8ff7-47f2-aebe-978650c0072c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:02:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:02:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fd4cf0c00155b1c8d0fe6f6046716517',container_format='bare',created_at=2023-07-27T17:02:35Z,direct_url=<?>,disk_format='qcow2',id=f5b65ec7-8ff7-47f2-aebe-978650c0072c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-905694853',owner='453f1bd5d8b347be913fe262b31a1c66',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-27T17:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992311',display_name='tempest-TestStampPattern-server-1992311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992311',id=42,image_ref='f5b65ec7-8ff7-47f2-aebe-978650c0072c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-jyec30up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e950d30-892f-471b-82d2-f435da94a63d',image_min_disk='1',image_min_ram='0',image_owner_id='453f1bd5d8b347be913fe262b31a1c66',image_owner_project_name='tempest-TestStampPattern-853432287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-853432287-project-member',image_user_id='914c6d75846846a2b944bfb6111f0341',network_allocated='True',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:02:44Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=38f1b8c5-6ca7-45bd-89ae-460fc8db15de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:02:46 user nova-compute[71026]:   <uuid>38f1b8c5-6ca7-45bd-89ae-460fc8db15de</uuid>
Jul 27 17:02:46 user nova-compute[71026]:   <name>instance-0000002a</name>
Jul 27 17:02:46 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:02:46 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:02:46 user nova-compute[71026]:   <metadata>
Jul 27 17:02:46 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:02:46 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:name>tempest-TestStampPattern-server-1992311</nova:name>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:02:46</nova:creationTime>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:02:46 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:02:46 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:owner>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:user uuid="914c6d75846846a2b944bfb6111f0341">tempest-TestStampPattern-853432287-project-member</nova:user>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:project uuid="453f1bd5d8b347be913fe262b31a1c66">tempest-TestStampPattern-853432287</nova:project>
Jul 27 17:02:46 user nova-compute[71026]:       </nova:owner>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:root type="image" uuid="f5b65ec7-8ff7-47f2-aebe-978650c0072c"/>
Jul 27 17:02:46 user nova-compute[71026]:       <nova:ports>
Jul 27 17:02:46 user nova-compute[71026]:         <nova:port uuid="06a6d492-3332-47f2-996c-7401ac201108">
Jul 27 17:02:46 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 17:02:46 user nova-compute[71026]:         </nova:port>
Jul 27 17:02:46 user nova-compute[71026]:       </nova:ports>
Jul 27 17:02:46 user nova-compute[71026]:     </nova:instance>
Jul 27 17:02:46 user nova-compute[71026]:   </metadata>
Jul 27 17:02:46 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:02:46 user nova-compute[71026]:     <system>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="serial">38f1b8c5-6ca7-45bd-89ae-460fc8db15de</entry>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="uuid">38f1b8c5-6ca7-45bd-89ae-460fc8db15de</entry>
Jul 27 17:02:46 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:02:46 user nova-compute[71026]:     </system>
Jul 27 17:02:46 user nova-compute[71026]:   </sysinfo>
Jul 27 17:02:46 user nova-compute[71026]:   <os>
Jul 27 17:02:46 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:02:46 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:02:46 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:02:46 user nova-compute[71026]:   </os>
Jul 27 17:02:46 user nova-compute[71026]:   <features>
Jul 27 17:02:46 user nova-compute[71026]:     <acpi/>
Jul 27 17:02:46 user nova-compute[71026]:     <apic/>
Jul 27 17:02:46 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:02:46 user nova-compute[71026]:   </features>
Jul 27 17:02:46 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:02:46 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:02:46 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:02:46 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:02:46 user nova-compute[71026]:   </clock>
Jul 27 17:02:46 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:02:46 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:02:46 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:02:46 user nova-compute[71026]:   </cpu>
Jul 27 17:02:46 user nova-compute[71026]:   <devices>
Jul 27 17:02:46 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:02:46 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:02:46 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk"/>
Jul 27 17:02:46 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:02:46 user nova-compute[71026]:     </disk>
Jul 27 17:02:46 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:02:46 user nova-compute[71026]:       <mac address="fa:16:3e:f2:c3:06"/>
Jul 27 17:02:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:02:46 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:02:46 user nova-compute[71026]:       <target dev="tap06a6d492-33"/>
Jul 27 17:02:46 user nova-compute[71026]:     </interface>
Jul 27 17:02:46 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:02:46 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/console.log" append="off"/>
Jul 27 17:02:46 user nova-compute[71026]:     </serial>
Jul 27 17:02:46 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:02:46 user nova-compute[71026]:     <video>
Jul 27 17:02:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:02:46 user nova-compute[71026]:     </video>
Jul 27 17:02:46 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:02:46 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:02:46 user nova-compute[71026]:     </rng>
Jul 27 17:02:46 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:02:46 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:02:46 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:02:46 user nova-compute[71026]:     </memballoon>
Jul 27 17:02:46 user nova-compute[71026]:   </devices>
Jul 27 17:02:46 user nova-compute[71026]: </domain>
Jul 27 17:02:46 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992311',display_name='tempest-TestStampPattern-server-1992311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992311',id=42,image_ref='f5b65ec7-8ff7-47f2-aebe-978650c0072c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-jyec30up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e950d30-892f-471b-82d2-f435da94a63d',image_min_disk='1',image_min_ram='0',image_owner_id='453f1bd5d8b347be913fe262b31a1c66',image_owner_project_name='tempest-TestStampPattern-853432287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-853432287-project-member',image_user_id='914c6d75846846a2b944bfb6111f0341',network_allocated='True',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:02:44Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=38f1b8c5-6ca7-45bd-89ae-460fc8db15de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG os_vif [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06a6d492-33, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06a6d492-33, col_values=(('external_ids', {'iface-id': '06a6d492-3332-47f2-996c-7401ac201108', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:c3:06', 'vm-uuid': '38f1b8c5-6ca7-45bd-89ae-460fc8db15de'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:46 user nova-compute[71026]: INFO os_vif [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33')
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No VIF found with MAC fa:16:3e:f2:c3:06, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updated VIF entry in instance network info cache for port 06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating instance_info_cache with network_info: [{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:02:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dce192e9-6d7a-40ac-8e2b-404da1c7503b req-c157a830-e468-4114-b100-37bd6267d721 service nova] Releasing lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:02:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] No waiting events found dispatching network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:02:48 user nova-compute[71026]: WARNING nova.compute.manager [req-76e76a6c-3131-446e-98db-17dbbe4c911d req-a6e26c25-f478-48c7-bfe5-97d961f01ac2 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received unexpected event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 for instance with vm_state building and task_state spawning.
Jul 27 17:02:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:02:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:49 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477354.854839, 23866140-3332-491e-97e5-fb64f82ae13f => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:02:49 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] VM Stopped (Lifecycle Event)
Jul 27 17:02:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e67846db-e159-4efa-9adc-27a223f776d3 None None] [instance: 23866140-3332-491e-97e5-fb64f82ae13f] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477370.0490317, 38f1b8c5-6ca7-45bd-89ae-460fc8db15de => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] VM Resumed (Lifecycle Event)
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Instance spawned successfully.
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477370.0504942, 38f1b8c5-6ca7-45bd-89ae-460fc8db15de => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] VM Started (Lifecycle Event)
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Took 5.84 seconds to spawn the instance on the hypervisor.
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] No waiting events found dispatching network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:02:50 user nova-compute[71026]: WARNING nova.compute.manager [req-5fac5207-3172-4cc3-a405-d5f3e6c69041 req-de483a20-a628-4a60-8ac1-6ee925a93d2e service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received unexpected event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 for instance with vm_state building and task_state spawning.
Jul 27 17:02:50 user nova-compute[71026]: INFO nova.compute.manager [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Took 6.58 seconds to build instance.
Jul 27 17:02:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f0d43c40-6dee-4a0e-853f-80dd8ef58dc5 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.674s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:02:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:02:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:03 user nova-compute[71026]: INFO nova.compute.manager [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Terminating instance
Jul 27 17:03:03 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG nova.compute.manager [req-0cef7195-1bfd-444d-a4c2-cc53b544547f req-5f134478-d750-4c3d-a12d-dbcf2afb9489 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-unplugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:03:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Instance destroyed successfully.
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'resources' on Instance uuid e5aa2385-ce14-4055-9aa4-666bbeb33dac {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T16:56:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-490787159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-490787159',id=34,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKspkk7w+FwtZQTLfjMBa/GZrR8Qmlkilyj67/n7Sa0+jnV9l7wAyDo6tff0DUzGromfCPkof+uL8AP61i11zb78DnUkWhykQRsL0iLbfHgX6TDXpnNF8Nz2ZfnGxIO+ZA==',key_name='tempest-keypair-539704832',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-ckli6h0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=e5aa2385-ce14-4055-9aa4-666bbeb33dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "address": "fa:16:3e:1e:a4:02", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb22bca0c-a4", "ovs_interfaceid": "b22bca0c-a4ec-4455-98b9-a5cac7e2efff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG os_vif [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb22bca0c-a4, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:03:04 user nova-compute[71026]: INFO os_vif [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:02,bridge_name='br-int',has_traffic_filtering=True,id=b22bca0c-a4ec-4455-98b9-a5cac7e2efff,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb22bca0c-a4')
Jul 27 17:03:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Deleting instance files /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac_del
Jul 27 17:03:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Deletion of /opt/stack/data/nova/instances/e5aa2385-ce14-4055-9aa4-666bbeb33dac_del complete
Jul 27 17:03:04 user nova-compute[71026]: INFO nova.compute.manager [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 17:03:04 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:04 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:03:05 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Took 0.86 seconds to deallocate network for instance.
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-63df80f3-b73e-4d7e-b2b8-93949097ae59 req-fb8e3114-2980-4b34-b3db-3c1111d00b99 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-deleted-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:05 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Deleted allocations for instance e5aa2385-ce14-4055-9aa4-666bbeb33dac
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1a07497c-660f-4580-bd11-9db5f10c3258 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.176s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] Acquiring lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] Lock "e5aa2385-ce14-4055-9aa4-666bbeb33dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:05 user nova-compute[71026]: DEBUG nova.compute.manager [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] No waiting events found dispatching network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:05 user nova-compute[71026]: WARNING nova.compute.manager [req-d97d4a59-b5e8-4ab4-8cfb-fee0126fe0bd req-e5da6efc-9b8f-4b53-a57e-31d1d80b1d24 service nova] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Received unexpected event network-vif-plugged-b22bca0c-a4ec-4455-98b9-a5cac7e2efff for instance with vm_state deleted and task_state None.
Jul 27 17:03:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:11 user nova-compute[71026]: INFO nova.compute.manager [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Terminating instance
Jul 27 17:03:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-unplugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] No waiting events found dispatching network-vif-unplugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-b3571490-7e6b-47e8-ae61-925471d3a1b9 req-7c619001-a927-493f-a1f6-d3021c02f17b service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-unplugged-8cb821e6-be7e-496b-ba75-11a149f88495 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Instance destroyed successfully.
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lazy-loading 'resources' on Instance uuid b03cbd5a-2085-43bb-a295-6aacc0e43dfc {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-891865890',display_name='tempest-VolumesNegativeTest-instance-891865890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-891865890',id=40,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:01:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3900f34346024543a4bc0daaabb71073',ramdisk_id='',reservation_id='r-u79y9n20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1377408799',owner_user_name='tempest-VolumesNegativeTest-1377408799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:01:28Z,user_data=None,user_id='d7a631743ff94eb39de07ab93dbab277',uuid=b03cbd5a-2085-43bb-a295-6aacc0e43dfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converting VIF {"id": "8cb821e6-be7e-496b-ba75-11a149f88495", "address": "fa:16:3e:c0:ff:20", "network": {"id": "70934484-5577-4dbf-92ba-bf64565b2eb4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bac095afc19c41b6970d6408ce418577", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb821e6-be", "ovs_interfaceid": "8cb821e6-be7e-496b-ba75-11a149f88495", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG os_vif [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb821e6-be, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:03:12 user nova-compute[71026]: INFO os_vif [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ff:20,bridge_name='br-int',has_traffic_filtering=True,id=8cb821e6-be7e-496b-ba75-11a149f88495,network=Network(70934484-5577-4dbf-92ba-bf64565b2eb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb821e6-be')
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Deleting instance files /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc_del
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Deletion of /opt/stack/data/nova/instances/b03cbd5a-2085-43bb-a295-6aacc0e43dfc_del complete
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.compute.manager [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 27 17:03:12 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Took 0.49 seconds to deallocate network for instance.
Jul 27 17:03:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:03:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:12 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Deleted allocations for instance b03cbd5a-2085-43bb-a295-6aacc0e43dfc
Jul 27 17:03:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5daf6d71-0026-4950-ae82-b95881dd9bc2 tempest-VolumesNegativeTest-1377408799 tempest-VolumesNegativeTest-1377408799-project-member] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] Acquiring lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] Lock "b03cbd5a-2085-43bb-a295-6aacc0e43dfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] No waiting events found dispatching network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:13 user nova-compute[71026]: WARNING nova.compute.manager [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received unexpected event network-vif-plugged-8cb821e6-be7e-496b-ba75-11a149f88495 for instance with vm_state deleted and task_state None.
Jul 27 17:03:13 user nova-compute[71026]: DEBUG nova.compute.manager [req-e0731beb-d44e-4c30-b225-56c9c254c5c4 req-26ba4c6d-aa67-4c5a-8d7c-6c923d808238 service nova] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Received event network-vif-deleted-8cb821e6-be7e-496b-ba75-11a149f88495 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:19 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477384.0524316, e5aa2385-ce14-4055-9aa4-666bbeb33dac => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:03:19 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] VM Stopped (Lifecycle Event)
Jul 27 17:03:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cb94e4ae-bf39-4957-be66-2cf7a401df45 None None] [instance: e5aa2385-ce14-4055-9aa4-666bbeb33dac] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:03:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:22 user nova-compute[71026]: INFO nova.compute.manager [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Rescuing
Jul 27 17:03:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:03:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:23 user nova-compute[71026]: WARNING nova.compute.manager [req-14b1aeb4-b18a-49ab-8591-c4ca52b1dbde req-ad8f8699-6781-40aa-a340-8cbc83098f77 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state rescuing.
Jul 27 17:03:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:23 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance destroyed successfully.
Jul 27 17:03:23 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Attempting a stable device rescue
Jul 27 17:03:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71026) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance directory exists: not creating {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 27 17:03:23 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Creating image(s)
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.part --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:24 user nova-compute[71026]: DEBUG nova.virt.images [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] 75792200-c3df-4b0b-b955-1ae702b1e69a was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:03:24 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:03:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.part /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.part /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.converted" returned: 0 in 0.235s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:25 user nova-compute[71026]: WARNING nova.compute.manager [req-4671aa7a-0520-4f26-86d2-985258a39841 req-f67cd224-3ea7-481b-8f59-3c5ba8e3fa7c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state rescuing.
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.517s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603 --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603,backing_fmt=raw /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603,backing_fmt=raw /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue" returned: 0 in 0.059s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "bc7a350a16ee2c68a09bceb9df98558b32afa603" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'migration_context' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start _get_guest_xml network_info=[{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:86:76:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '75792200-c3df-4b0b-b955-1ae702b1e69a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '04b7b900-cea3-4ee5-866a-5d143c94a69c', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1d0485a3-06b6-4f95-972a-fadb9f03d235', 'attached_at': '', 'detached_at': '', 'volume_id': '58334e63-fa95-4139-8366-e6c3bfbebfa9', 'serial': '58334e63-fa95-4139-8366-e6c3bfbebfa9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:25 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:03:25 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:03:25 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:03:25 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:03:25 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebe83b-0c03-4c56-a8cf-41314e5ef60f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NbzYTZrD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 27 17:03:25 user nova-compute[71026]: node.name = iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9
Jul 27 17:03:25 user nova-compute[71026]: node.tpgt = -1
Jul 27 17:03:25 user nova-compute[71026]: node.startup = automatic
Jul 27 17:03:25 user nova-compute[71026]: node.leading_login = No
Jul 27 17:03:25 user nova-compute[71026]: iface.iscsi_ifacename = default
Jul 27 17:03:25 user nova-compute[71026]: iface.net_ifacename = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.ipaddress = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.prefix_len = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.hwaddress = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.transport_name = tcp
Jul 27 17:03:25 user nova-compute[71026]: iface.initiatorname = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.vlan_id = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.vlan_priority = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.vlan_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.iface_num = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.mtu = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.port = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.bootproto = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.subnet_mask = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.gateway = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_alt_client_id_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_alt_client_id = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_dns = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_learn_iqn = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_req_vendor_id_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_vendor_id_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_vendor_id = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.dhcp_slp_da = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.fragmentation = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.gratuitous_arp = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.incoming_forwarding = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.tos_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.tos = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.ttl = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.delayed_ack = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.tcp_nagle = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.tcp_wsf_state = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.tcp_wsf = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.tcp_timer_scale = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.tcp_timestamp = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.redirect = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.def_task_mgmt_timeout = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.header_digest = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.data_digest = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.immediate_data = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.initial_r2t = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.data_seq_inorder = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.data_pdu_inorder = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.erl = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.max_receive_data_len = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.first_burst_len = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.max_outstanding_r2t = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.max_burst_len = 0
Jul 27 17:03:25 user nova-compute[71026]: iface.chap_auth = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.bidi_chap = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.strict_login_compliance = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.discovery_auth = <empty>
Jul 27 17:03:25 user nova-compute[71026]: iface.discovery_logout = <empty>
Jul 27 17:03:25 user nova-compute[71026]: node.discovery_address = <empty>
Jul 27 17:03:25 user nova-compute[71026]: node.discovery_port = 0
Jul 27 17:03:25 user nova-compute[71026]: node.discovery_type = static
Jul 27 17:03:25 user nova-compute[71026]: node.session.initial_cmdsn = 0
Jul 27 17:03:25 user nova-compute[71026]: node.session.initial_login_retry_max = 8
Jul 27 17:03:25 user nova-compute[71026]: node.session.xmit_thread_priority = -20
Jul 27 17:03:25 user nova-compute[71026]: node.session.cmds_max = 128
Jul 27 17:03:25 user nova-compute[71026]: node.session.queue_depth = 32
Jul 27 17:03:25 user nova-compute[71026]: node.session.nr_sessions = 1
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.authmethod = CHAP
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.username = NbzYTZrD
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.password = ***
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.username_in = <empty>
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.password_in = <empty>
Jul 27 17:03:25 user nova-compute[71026]: node.session.auth.chap_algs = MD5
Jul 27 17:03:25 user nova-compute[71026]: node.session.timeo.replacement_timeout = 120
Jul 27 17:03:25 user nova-compute[71026]: node.session.err_timeo.abort_timeout = 15
Jul 27 17:03:25 user nova-compute[71026]: node.session.err_timeo.lu_reset_timeout = 30
Jul 27 17:03:25 user nova-compute[71026]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 27 17:03:25 user nova-compute[71026]: node.session.err_timeo.host_reset_timeout = 60
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.FastAbort = Yes
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.InitialR2T = No
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.ImmediateData = Yes
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.FirstBurstLength = 262144
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.MaxBurstLength = 16776192
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.DefaultTime2Retain = 0
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.DefaultTime2Wait = 2
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.MaxConnections = 1
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 27 17:03:25 user nova-compute[71026]: node.session.iscsi.ERL = 0
Jul 27 17:03:25 user nova-compute[71026]: node.session.scan = manual
Jul 27 17:03:25 user nova-compute[71026]: node.session.reopen_max = 0
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].address = 172.16.0.220
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].port = 3260
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].startup = manual
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].tcp.window_size = 524288
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].tcp.type_of_service = 0
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].timeo.logout_timeout = 15
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].timeo.login_timeout = 15
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].timeo.auth_timeout = 45
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].timeo.noop_out_interval = 5
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].timeo.noop_out_timeout = 5
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.HeaderDigest = None
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.DataDigest = None
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.IFMarker = No
Jul 27 17:03:25 user nova-compute[71026]: node.conn[0].iscsi.OFMarker = No
Jul 27 17:03:25 user nova-compute[71026]: # END RECORD
Jul 27 17:03:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41eb4f1-4396-4a55-803a-1f0c5979c78d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f487c6a-d6e0-4959-ad3e-3608ebd64ac9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzYTZrD {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbzYTZrD" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2afb72-f49f-4385-bc77-da7a9e2d348d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbzYTZrD'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2297b955-74c7-477b-8b4e-ad29a665bfa2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25094c6-5961-420d-819c-5fd60b1e0fe6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:03:25 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:03:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:03:25 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:03:25 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] HCTL ('35', '0', '0', 0) found on session 51 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[99746b39-56eb-442c-a2d2-bbd0ef41b5ab]: (4, ('0 0 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Searching for a device in session 51 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23836396361333735', 'path': '/dev/sdd'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836396361333735', 'path': '/dev/sdd'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818328519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818328519',id=41,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:01:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-702fmsjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:01:51Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=1d0485a3-06b6-4f95-972a-fadb9f03d235,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:86:76:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "vif_mac": "fa:16:3e:86:76:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:03:25 user nova-compute[71026]:   <uuid>1d0485a3-06b6-4f95-972a-fadb9f03d235</uuid>
Jul 27 17:03:25 user nova-compute[71026]:   <name>instance-00000029</name>
Jul 27 17:03:25 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:03:25 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:03:25 user nova-compute[71026]:   <metadata>
Jul 27 17:03:25 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:03:25 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1818328519</nova:name>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:03:25</nova:creationTime>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:03:25 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:03:25 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:owner>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:user uuid="0c742ca26757400288ef69caac251d91">tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member</nova:user>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:project uuid="6cbbd8fb9af44b38b4c48be901f137a0">tempest-ServerBootFromVolumeStableRescueTest-996401610</nova:project>
Jul 27 17:03:25 user nova-compute[71026]:       </nova:owner>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:03:25 user nova-compute[71026]:       <nova:ports>
Jul 27 17:03:25 user nova-compute[71026]:         <nova:port uuid="c051e627-8c47-4070-9b5c-f5f50420713a">
Jul 27 17:03:25 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:03:25 user nova-compute[71026]:         </nova:port>
Jul 27 17:03:25 user nova-compute[71026]:       </nova:ports>
Jul 27 17:03:25 user nova-compute[71026]:     </nova:instance>
Jul 27 17:03:25 user nova-compute[71026]:   </metadata>
Jul 27 17:03:25 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:03:25 user nova-compute[71026]:     <system>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="serial">1d0485a3-06b6-4f95-972a-fadb9f03d235</entry>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="uuid">1d0485a3-06b6-4f95-972a-fadb9f03d235</entry>
Jul 27 17:03:25 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:03:25 user nova-compute[71026]:     </system>
Jul 27 17:03:25 user nova-compute[71026]:   </sysinfo>
Jul 27 17:03:25 user nova-compute[71026]:   <os>
Jul 27 17:03:25 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:03:25 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:03:25 user nova-compute[71026]:   </os>
Jul 27 17:03:25 user nova-compute[71026]:   <features>
Jul 27 17:03:25 user nova-compute[71026]:     <acpi/>
Jul 27 17:03:25 user nova-compute[71026]:     <apic/>
Jul 27 17:03:25 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:03:25 user nova-compute[71026]:   </features>
Jul 27 17:03:25 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:03:25 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:03:25 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:03:25 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:03:25 user nova-compute[71026]:   </clock>
Jul 27 17:03:25 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:03:25 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:03:25 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:03:25 user nova-compute[71026]:   </cpu>
Jul 27 17:03:25 user nova-compute[71026]:   <devices>
Jul 27 17:03:25 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 17:03:25 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:03:25 user nova-compute[71026]:       <source dev="/dev/sdd"/>
Jul 27 17:03:25 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:03:25 user nova-compute[71026]:       <serial>58334e63-fa95-4139-8366-e6c3bfbebfa9</serial>
Jul 27 17:03:25 user nova-compute[71026]:     </disk>
Jul 27 17:03:25 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:03:25 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:03:25 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue"/>
Jul 27 17:03:25 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 17:03:25 user nova-compute[71026]:       <boot order="1"/>
Jul 27 17:03:25 user nova-compute[71026]:     </disk>
Jul 27 17:03:25 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:03:25 user nova-compute[71026]:       <mac address="fa:16:3e:86:76:3b"/>
Jul 27 17:03:25 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:03:25 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:03:25 user nova-compute[71026]:       <target dev="tapc051e627-8c"/>
Jul 27 17:03:25 user nova-compute[71026]:     </interface>
Jul 27 17:03:25 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:03:25 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/console.log" append="off"/>
Jul 27 17:03:25 user nova-compute[71026]:     </serial>
Jul 27 17:03:25 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:03:25 user nova-compute[71026]:     <video>
Jul 27 17:03:25 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:03:25 user nova-compute[71026]:     </video>
Jul 27 17:03:25 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:03:25 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:03:25 user nova-compute[71026]:     </rng>
Jul 27 17:03:25 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:03:25 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:03:25 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:03:25 user nova-compute[71026]:     </memballoon>
Jul 27 17:03:25 user nova-compute[71026]:   </devices>
Jul 27 17:03:25 user nova-compute[71026]: </domain>
Jul 27 17:03:25 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:03:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance destroyed successfully.
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:03:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] No VIF found with MAC fa:16:3e:86:76:3b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477392.030349, b03cbd5a-2085-43bb-a295-6aacc0e43dfc => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:03:27 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] VM Stopped (Lifecycle Event)
Jul 27 17:03:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d10fe426-9867-4f40-b2dc-658afd530351 None None] [instance: b03cbd5a-2085-43bb-a295-6aacc0e43dfc] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:27 user nova-compute[71026]: WARNING nova.compute.manager [req-ad65d6ad-994a-4270-aa47-f14fc54375d7 req-45e1e26b-77bb-4d3e-a438-637d5f4a62ba service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state rescuing.
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:03:29 user nova-compute[71026]: WARNING nova.compute.manager [req-dd3fcea4-4354-47bb-9d04-c03484a57e96 req-e37fbbf6-5b73-4840-bfde-43797179e05a service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state rescuing.
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 1d0485a3-06b6-4f95-972a-fadb9f03d235 due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477409.3257055, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:03:29 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Resumed (Lifecycle Event)
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5e693f22-2809-41c6-b752-b464d21d367c tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:03:29 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477409.3265004, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:03:29 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Started (Lifecycle Event)
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:03:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:34 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:03:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updating instance_info_cache with network_info: [{"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:03:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-4a661cd6-8dfb-4266-a5ca-cea210c9080a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:03:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:03:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:03:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8066MB free_disk=25.16070556640625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:03:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:03:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:03:58 user nova-compute[71026]: INFO nova.compute.claims [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Claim successful on node user
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.314s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:03:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:03:58 user nova-compute[71026]: DEBUG nova.policy [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62e60e4b7b164fc19a1d932799eca227', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebe60ded919474b85143cbe6d607ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:03:59 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Creating image(s)
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk 1073741824" returned: 0 in 0.052s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Successfully created port: 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Cannot resize image /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'migration_context' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Ensure instance console log exists: /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:03:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Successfully updated port: 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.compute.manager [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing instance network info cache due to event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.neutron [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance network_info: |[{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start _get_guest_xml network_info=[{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:04:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjBb4WOywx/57jlmdpLXEfz/B/yawm7Z3KnXcgt1fOOQbXbWj7+c++K5B60UI/MjSIcqeb2c9aKlgshIB/+OeRb4IyF9Q76Dcow7CMATLtxEYzIV1HcoNXfyzx+/ztCng==',key_name='tempest-keypair-2030639588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_devices' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:04:00 user nova-compute[71026]:   <uuid>dc7eeb03-4739-485c-b7ce-3f2f8535921a</uuid>
Jul 27 17:04:00 user nova-compute[71026]:   <name>instance-0000002b</name>
Jul 27 17:04:00 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:04:00 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:04:00 user nova-compute[71026]:   <metadata>
Jul 27 17:04:00 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:04:00 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1577878567</nova:name>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:04:00</nova:creationTime>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:04:00 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:04:00 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:owner>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:user uuid="62e60e4b7b164fc19a1d932799eca227">tempest-AttachVolumeShelveTestJSON-576960083-project-member</nova:user>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:project uuid="bebe60ded919474b85143cbe6d607ba5">tempest-AttachVolumeShelveTestJSON-576960083</nova:project>
Jul 27 17:04:00 user nova-compute[71026]:       </nova:owner>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:04:00 user nova-compute[71026]:       <nova:ports>
Jul 27 17:04:00 user nova-compute[71026]:         <nova:port uuid="8d39328f-51e8-4760-9f5d-7d52394b9ec6">
Jul 27 17:04:00 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 17:04:00 user nova-compute[71026]:         </nova:port>
Jul 27 17:04:00 user nova-compute[71026]:       </nova:ports>
Jul 27 17:04:00 user nova-compute[71026]:     </nova:instance>
Jul 27 17:04:00 user nova-compute[71026]:   </metadata>
Jul 27 17:04:00 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:04:00 user nova-compute[71026]:     <system>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="serial">dc7eeb03-4739-485c-b7ce-3f2f8535921a</entry>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="uuid">dc7eeb03-4739-485c-b7ce-3f2f8535921a</entry>
Jul 27 17:04:00 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:04:00 user nova-compute[71026]:     </system>
Jul 27 17:04:00 user nova-compute[71026]:   </sysinfo>
Jul 27 17:04:00 user nova-compute[71026]:   <os>
Jul 27 17:04:00 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:04:00 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:04:00 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:04:00 user nova-compute[71026]:   </os>
Jul 27 17:04:00 user nova-compute[71026]:   <features>
Jul 27 17:04:00 user nova-compute[71026]:     <acpi/>
Jul 27 17:04:00 user nova-compute[71026]:     <apic/>
Jul 27 17:04:00 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:04:00 user nova-compute[71026]:   </features>
Jul 27 17:04:00 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:04:00 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:04:00 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:04:00 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:04:00 user nova-compute[71026]:   </clock>
Jul 27 17:04:00 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:04:00 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:04:00 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:04:00 user nova-compute[71026]:   </cpu>
Jul 27 17:04:00 user nova-compute[71026]:   <devices>
Jul 27 17:04:00 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:04:00 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:04:00 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk"/>
Jul 27 17:04:00 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:04:00 user nova-compute[71026]:     </disk>
Jul 27 17:04:00 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:04:00 user nova-compute[71026]:       <mac address="fa:16:3e:5a:cb:27"/>
Jul 27 17:04:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:04:00 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:04:00 user nova-compute[71026]:       <target dev="tap8d39328f-51"/>
Jul 27 17:04:00 user nova-compute[71026]:     </interface>
Jul 27 17:04:00 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:04:00 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/console.log" append="off"/>
Jul 27 17:04:00 user nova-compute[71026]:     </serial>
Jul 27 17:04:00 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:04:00 user nova-compute[71026]:     <video>
Jul 27 17:04:00 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:04:00 user nova-compute[71026]:     </video>
Jul 27 17:04:00 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:04:00 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:04:00 user nova-compute[71026]:     </rng>
Jul 27 17:04:00 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:04:00 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:04:00 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:04:00 user nova-compute[71026]:     </memballoon>
Jul 27 17:04:00 user nova-compute[71026]:   </devices>
Jul 27 17:04:00 user nova-compute[71026]: </domain>
Jul 27 17:04:00 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjBb4WOywx/57jlmdpLXEfz/B/yawm7Z3KnXcgt1fOOQbXbWj7+c++K5B60UI/MjSIcqeb2c9aKlgshIB/+OeRb4IyF9Q76Dcow7CMATLtxEYzIV1HcoNXfyzx+/ztCng==',key_name='tempest-keypair-2030639588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:03:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG os_vif [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d39328f-51, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d39328f-51, col_values=(('external_ids', {'iface-id': '8d39328f-51e8-4760-9f5d-7d52394b9ec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:cb:27', 'vm-uuid': 'dc7eeb03-4739-485c-b7ce-3f2f8535921a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:00 user nova-compute[71026]: INFO os_vif [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51')
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:04:00 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No VIF found with MAC fa:16:3e:5a:cb:27, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:04:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updated VIF entry in instance network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:04:01 user nova-compute[71026]: DEBUG nova.network.neutron [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-7ba3c38a-b25b-403e-8db0-ef38e4b82f9b req-68b6e0b6-b424-4c5b-836f-433b0002b676 service nova] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:04:02 user nova-compute[71026]: WARNING nova.compute.manager [req-122b38cb-f7e6-4a6c-ade2-7dcee5c18f39 req-9ad82e11-ab73-455d-8c32-36c7c9c6d411 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state building and task_state spawning.
Jul 27 17:04:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477444.3229108, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Resumed (Lifecycle Event)
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance spawned successfully.
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477444.3271935, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Started (Lifecycle Event)
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Took 5.44 seconds to spawn the instance on the hypervisor.
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:04:04 user nova-compute[71026]: WARNING nova.compute.manager [req-cfce9bbf-322d-45e2-bc57-cecd5e098e17 req-891dfcd1-bd06-4787-8033-6f9244de856f service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state building and task_state spawning.
Jul 27 17:04:04 user nova-compute[71026]: INFO nova.compute.manager [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Took 6.10 seconds to build instance.
Jul 27 17:04:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c7b5b1e5-98b8-4301-898e-974387cc2de1 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.218s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:04:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:31 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:04:33 user nova-compute[71026]: INFO nova.compute.claims [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Claim successful on node user
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:04:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:04:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.policy [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27622507ef1240d9adf5d005035e2bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9953dd1d0240c8876b8235e47740de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:04:34 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Creating image(s)
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "/opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "/opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "/opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk 1073741824" returned: 0 in 0.058s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.156s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Cannot resize image /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'migration_context' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Ensure instance console log exists: /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Successfully created port: 9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Successfully updated port: 9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquired lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-changed-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.compute.manager [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Refreshing instance network info cache due to event network-changed-9e51db72-bd9a-4ee7-98ab-a56779ef50c6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] Acquiring lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:35 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-changed-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing instance network info cache due to event network-changed-06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] Acquiring lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] Acquired lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing network info cache for port 06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updating instance_info_cache with network_info: [{"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Releasing lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Instance network_info: |[{"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] Acquired lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Refreshing network info cache for port 9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Start _get_guest_xml network_info=[{"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:04:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:36 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-148043497',display_name='tempest-VolumesSnapshotTestJSON-instance-148043497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-148043497',id=44,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPIY0Qgd7Of3XCTQVcF2NXjh75k70x3eP1K0DTZxjaHgFoZBEtGgKEPJfPVSoERffRtWs2Aq6jIzodhhRjc4KY+m/IGM/maSTiEbGUOcmjxzB/sdL6SeEM4Psd+CyyamA==',key_name='tempest-keypair-1779694269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-v32fcp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=337be0db-1456-4391-90c0-c6a5b75fc04a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'pci_devices' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:04:36 user nova-compute[71026]:   <uuid>337be0db-1456-4391-90c0-c6a5b75fc04a</uuid>
Jul 27 17:04:36 user nova-compute[71026]:   <name>instance-0000002c</name>
Jul 27 17:04:36 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:04:36 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:04:36 user nova-compute[71026]:   <metadata>
Jul 27 17:04:36 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:04:36 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-148043497</nova:name>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:04:36</nova:creationTime>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:04:36 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:04:36 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:owner>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:user uuid="27622507ef1240d9adf5d005035e2bc9">tempest-VolumesSnapshotTestJSON-270009591-project-member</nova:user>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:project uuid="fd9953dd1d0240c8876b8235e47740de">tempest-VolumesSnapshotTestJSON-270009591</nova:project>
Jul 27 17:04:36 user nova-compute[71026]:       </nova:owner>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:04:36 user nova-compute[71026]:       <nova:ports>
Jul 27 17:04:36 user nova-compute[71026]:         <nova:port uuid="9e51db72-bd9a-4ee7-98ab-a56779ef50c6">
Jul 27 17:04:36 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 17:04:36 user nova-compute[71026]:         </nova:port>
Jul 27 17:04:36 user nova-compute[71026]:       </nova:ports>
Jul 27 17:04:36 user nova-compute[71026]:     </nova:instance>
Jul 27 17:04:36 user nova-compute[71026]:   </metadata>
Jul 27 17:04:36 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:04:36 user nova-compute[71026]:     <system>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="serial">337be0db-1456-4391-90c0-c6a5b75fc04a</entry>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="uuid">337be0db-1456-4391-90c0-c6a5b75fc04a</entry>
Jul 27 17:04:36 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:04:36 user nova-compute[71026]:     </system>
Jul 27 17:04:36 user nova-compute[71026]:   </sysinfo>
Jul 27 17:04:36 user nova-compute[71026]:   <os>
Jul 27 17:04:36 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:04:36 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:04:36 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:04:36 user nova-compute[71026]:   </os>
Jul 27 17:04:36 user nova-compute[71026]:   <features>
Jul 27 17:04:36 user nova-compute[71026]:     <acpi/>
Jul 27 17:04:36 user nova-compute[71026]:     <apic/>
Jul 27 17:04:36 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:04:36 user nova-compute[71026]:   </features>
Jul 27 17:04:36 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:04:36 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:04:36 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:04:36 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:04:36 user nova-compute[71026]:   </clock>
Jul 27 17:04:36 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:04:36 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:04:36 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:04:36 user nova-compute[71026]:   </cpu>
Jul 27 17:04:36 user nova-compute[71026]:   <devices>
Jul 27 17:04:36 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:04:36 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:04:36 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk"/>
Jul 27 17:04:36 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:04:36 user nova-compute[71026]:     </disk>
Jul 27 17:04:36 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:04:36 user nova-compute[71026]:       <mac address="fa:16:3e:9b:5f:9b"/>
Jul 27 17:04:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:04:36 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:04:36 user nova-compute[71026]:       <target dev="tap9e51db72-bd"/>
Jul 27 17:04:36 user nova-compute[71026]:     </interface>
Jul 27 17:04:36 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:04:36 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/console.log" append="off"/>
Jul 27 17:04:36 user nova-compute[71026]:     </serial>
Jul 27 17:04:36 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:04:36 user nova-compute[71026]:     <video>
Jul 27 17:04:36 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:04:36 user nova-compute[71026]:     </video>
Jul 27 17:04:36 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:04:36 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:04:36 user nova-compute[71026]:     </rng>
Jul 27 17:04:36 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:04:36 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:04:36 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:04:36 user nova-compute[71026]:     </memballoon>
Jul 27 17:04:36 user nova-compute[71026]:   </devices>
Jul 27 17:04:36 user nova-compute[71026]: </domain>
Jul 27 17:04:36 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-148043497',display_name='tempest-VolumesSnapshotTestJSON-instance-148043497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-148043497',id=44,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPIY0Qgd7Of3XCTQVcF2NXjh75k70x3eP1K0DTZxjaHgFoZBEtGgKEPJfPVSoERffRtWs2Aq6jIzodhhRjc4KY+m/IGM/maSTiEbGUOcmjxzB/sdL6SeEM4Psd+CyyamA==',key_name='tempest-keypair-1779694269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-v32fcp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=337be0db-1456-4391-90c0-c6a5b75fc04a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG os_vif [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e51db72-bd, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e51db72-bd, col_values=(('external_ids', {'iface-id': '9e51db72-bd9a-4ee7-98ab-a56779ef50c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:5f:9b', 'vm-uuid': '337be0db-1456-4391-90c0-c6a5b75fc04a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:36 user nova-compute[71026]: INFO os_vif [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd')
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No VIF found with MAC fa:16:3e:9b:5f:9b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updated VIF entry in instance network info cache for port 06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating instance_info_cache with network_info: [{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9ecebf04-6ac6-4038-b4ce-ca6c78b12931 req-a30c67c6-d509-4265-ad78-808f1f7c8977 service nova] Releasing lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updated VIF entry in instance network info cache for port 9e51db72-bd9a-4ee7-98ab-a56779ef50c6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG nova.network.neutron [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updating instance_info_cache with network_info: [{"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d2e9ae48-ee5c-4c70-8aa4-b68b4d63049b req-0dc58576-e768-4838-af66-31929e4e4fe6 service nova] Releasing lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:38 user nova-compute[71026]: INFO nova.compute.manager [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Attaching volume a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 to /dev/vdb
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] No waiting events found dispatching network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:04:38 user nova-compute[71026]: WARNING nova.compute.manager [req-6f12cca2-2490-40c0-9eee-352f78458bf3 req-21c23a01-bda6-402e-adfa-c8b42ed14778 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received unexpected event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 for instance with vm_state building and task_state spawning.
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[74220b7d-345f-43bf-bd2f-1a5e953ec16e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea123b8-1bec-425d-829f-052275c644e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d34759-9bb8-4729-8bb4-d3dad3a5ca55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a79a3fb-d4d7-4b7c-9b2e-1c4898f09931]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:04:38 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:04:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9a91f-3324-4484-8bfd-b47e87de8e58]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating existing volume attachment record: 658d108d-5752-458d-a73a-3054a346ca91 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:39 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:04:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:04:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:04:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477480.0860713, 337be0db-1456-4391-90c0-c6a5b75fc04a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] VM Resumed (Lifecycle Event)
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Instance spawned successfully.
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477480.0884898, 337be0db-1456-4391-90c0-c6a5b75fc04a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] VM Started (Lifecycle Event)
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Took 6.10 seconds to spawn the instance on the hypervisor.
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] No waiting events found dispatching network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:04:40 user nova-compute[71026]: WARNING nova.compute.manager [req-c3cffdcc-20cc-4107-ae6b-43bd8dbd7d96 req-68def61b-590a-4339-b27e-de5ae8e1458b service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received unexpected event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 for instance with vm_state building and task_state spawning.
Jul 27 17:04:40 user nova-compute[71026]: INFO nova.compute.manager [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Took 6.81 seconds to build instance.
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0e36aeed-de06-4c1d-8998-df7526223422 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.906s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:41 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:42 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:04:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=25.12631607055664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dc7eeb03-4739-485c-b7ce-3f2f8535921a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 337be0db-1456-4391-90c0-c6a5b75fc04a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:04:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVPmljKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:04:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:04:45 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:04:45 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c631ab46-7967-4ca1-867c-6e31c03cd699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:04:45 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99ed2bb-f409-4df7-bbd3-2f18948bd9e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1] added
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[161e8d63-829c-4161-8b40-25c58c51b5c9]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[708dbf47-ea57-4e57-896f-9452e9f95c16]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVPmljKv {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVPmljKv" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897efd9-1366-4029-a13c-7dde4abbd1ad]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVPmljKv'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d192ad4-546a-4ec8-ba31-84be80e63826]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb10bac-146a-4d50-a707-35bc2f769fd8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f749c0c-f90c-4e3b-927a-88dea2f67acd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260]
Jul 27 17:04:45 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260] successful.
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a9e70-cbe1-4843-8372-15d7104dd8ff]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c5aaa-aec0-4c15-8462-7bfe731f98e6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)
Jul 27 17:04:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a84c9-5494-4ed1-9fef-34cd7d1de3bd]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:04:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVPmljKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:04:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:04:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23436366235663366', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:04:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436366235663366', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:04:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:04:47 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:04:47 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:04:47 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:04:47 user nova-compute[71026]:   <serial>a358a87d-3d17-40d2-bb6d-90d2d1fed1c1</serial>
Jul 27 17:04:47 user nova-compute[71026]: </disk>
Jul 27 17:04:47 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] No VIF found with MAC fa:16:3e:f2:c3:06, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:04:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c1f13cc-27cb-4457-8247-f15a5c3268de tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.462s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:04:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:04:48 user nova-compute[71026]: INFO nova.compute.manager [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Detaching volume a358a87d-3d17-40d2-bb6d-90d2d1fed1c1
Jul 27 17:04:49 user nova-compute[71026]: INFO nova.virt.block_device [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Attempting to driver detach volume a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 from mountpoint /dev/vdb
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Attempting to detach device vdb from instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:04:49 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:04:49 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:04:49 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:04:49 user nova-compute[71026]:   <serial>a358a87d-3d17-40d2-bb6d-90d2d1fed1c1</serial>
Jul 27 17:04:49 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:04:49 user nova-compute[71026]: </disk>
Jul 27 17:04:49 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:04:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully detached device vdb from instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de from the persistent domain config.
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:04:49 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:04:49 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:04:49 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:04:49 user nova-compute[71026]:   <serial>a358a87d-3d17-40d2-bb6d-90d2d1fed1c1</serial>
Jul 27 17:04:49 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:04:49 user nova-compute[71026]: </disk>
Jul 27 17:04:49 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477489.4720438, 38f1b8c5-6ca7-45bd-89ae-460fc8db15de => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:04:49 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully detached device vdb from instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de from the live domain config.
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVPmljKv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:04:49 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1e10e-14c6-4ba0-b071-7026dc3b8176]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:04:49 user nova-compute[71026]: No targets found.
Jul 27 17:04:49 user nova-compute[71026]: iSNS:
Jul 27 17:04:49 user nova-compute[71026]: No targets found.
Jul 27 17:04:49 user nova-compute[71026]: STATIC:
Jul 27 17:04:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9
Jul 27 17:04:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:04:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:04:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1
Jul 27 17:04:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:04:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:04:49 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:04:49 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:04:49 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:04:49 user nova-compute[71026]: FIRMWARE:
Jul 27 17:04:49 user nova-compute[71026]: No targets found.
Jul 27 17:04:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:04:49 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:04:49 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ebcbd-98a9-4a4a-8ddc-5143e65b3854]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e6fe5-6606-42a8-8525-b894ff2a8645]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:49 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:49 user nova-compute[71026]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)
Jul 27 17:04:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:04:49 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:04:49 user nova-compute[71026]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 (non-flash)
Jul 27 17:04:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3068631b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f65165-d39b-4aea-9d75-949a4b003287]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a89fb-4b45-4c25-8cd6-79c3c38f833c]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf20f3c2-c248-4f41-a8a2-391e2c7a577f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4087f889-9cf8-42c5-8f7d-96adc6b4f390]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671939f-3ef9-4bbb-bdc2-f5dc4c9abc20]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeffaa1b-fb00-4495-985a-42007cffc43f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260]
Jul 27 17:04:49 user nova-compute[71026]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1, portal: 172.16.0.220,3260] successful.
Jul 27 17:04:49 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a358a87d-3d17-40d2-bb6d-90d2d1fed1c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84438459-0214-4198-8650-88721b3c56ee]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] <== disconnect_volume: return (305ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:04:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:04:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'flavor' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:04:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-eca6f6f9-ddad-4f2f-8499-787fe94eb1f1 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:04:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:04:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:13 user nova-compute[71026]: INFO nova.compute.manager [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Unrescuing
Jul 27 17:05:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:05:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquired lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:05:13 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG nova.network.neutron [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [{"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Releasing lock "refresh_cache-1d0485a3-06b6-4f95-972a-fadb9f03d235" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'flavor' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:14 user nova-compute[71026]: WARNING nova.compute.manager [req-27ddbb4f-8fc6-4396-9ad8-68dc70c91b91 req-03d8a2c7-90e7-4c75-8f66-29eb8d257136 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state rescued and task_state unrescuing.
Jul 27 17:05:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance destroyed successfully.
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:16 user nova-compute[71026]: WARNING nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state rescued and task_state unrescuing.
Jul 27 17:05:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:16 user nova-compute[71026]: WARNING nova.compute.manager [req-40c7c750-ca1e-47b3-91f5-5e2786b8d541 req-a43ffdb9-d420-43e1-804a-e27448f43b00 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state rescued and task_state unrescuing.
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 1d0485a3-06b6-4f95-972a-fadb9f03d235 due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477518.2232964, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:05:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Resumed (Lifecycle Event)
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0eec7a30-988c-4d8e-b5e3-0cd40c078161 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:05:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477518.2250779, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:05:18 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Started (Lifecycle Event)
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:18 user nova-compute[71026]: DEBUG nova.compute.manager [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:18 user nova-compute[71026]: WARNING nova.compute.manager [req-c9ee6a05-4e8b-4eff-88b6-12b1c68b3798 req-2bac2b26-50ea-4b9d-95ff-d684573bcbcb service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state None.
Jul 27 17:05:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:05:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:05:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:05:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:05:38 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-changed-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing instance network info cache due to event network-changed-06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] Acquiring lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] Acquired lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG nova.network.neutron [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Refreshing network info cache for port 06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:39 user nova-compute[71026]: INFO nova.compute.manager [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Terminating instance
Jul 27 17:05:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-unplugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] No waiting events found dispatching network-vif-unplugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-2084c09e-33a6-4146-a304-7760e39e2c96 req-8b35f32f-fe65-4db7-afe7-84173e2923e5 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-unplugged-06a6d492-3332-47f2-996c-7401ac201108 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.network.neutron [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updated VIF entry in instance network info cache for port 06a6d492-3332-47f2-996c-7401ac201108. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.network.neutron [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating instance_info_cache with network_info: [{"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-df19aad7-3cd3-4ced-8909-c4aaf27d5470 req-4ba6696f-417a-48a6-87a8-6583c1cf79ad service nova] Releasing lock "refresh_cache-38f1b8c5-6ca7-45bd-89ae-460fc8db15de" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:05:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Instance destroyed successfully.
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'resources' on Instance uuid 38f1b8c5-6ca7-45bd-89ae-460fc8db15de {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1992311',display_name='tempest-TestStampPattern-server-1992311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1992311',id=42,image_ref='f5b65ec7-8ff7-47f2-aebe-978650c0072c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-jyec30up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6e950d30-892f-471b-82d2-f435da94a63d',image_min_disk='1',image_min_ram='0',image_owner_id='453f1bd5d8b347be913fe262b31a1c66',image_owner_project_name='tempest-TestStampPattern-853432287',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-853432287-project-member',image_user_id='914c6d75846846a2b944bfb6111f0341',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:02:50Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=38f1b8c5-6ca7-45bd-89ae-460fc8db15de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "06a6d492-3332-47f2-996c-7401ac201108", "address": "fa:16:3e:f2:c3:06", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06a6d492-33", "ovs_interfaceid": "06a6d492-3332-47f2-996c-7401ac201108", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG os_vif [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06a6d492-33, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:05:40 user nova-compute[71026]: INFO os_vif [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c3:06,bridge_name='br-int',has_traffic_filtering=True,id=06a6d492-3332-47f2-996c-7401ac201108,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06a6d492-33')
Jul 27 17:05:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Deleting instance files /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de_del
Jul 27 17:05:40 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Deletion of /opt/stack/data/nova/instances/38f1b8c5-6ca7-45bd-89ae-460fc8db15de_del complete
Jul 27 17:05:40 user nova-compute[71026]: INFO nova.compute.manager [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 17:05:40 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:05:40 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:41 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Took 0.44 seconds to deallocate network for instance.
Jul 27 17:05:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:41 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Deleted allocations for instance 38f1b8c5-6ca7-45bd-89ae-460fc8db15de
Jul 27 17:05:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-3ce70d1d-96f9-4350-b859-5ef63248e128 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.731s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-3b471f56-f2d8-4073-8dea-1235d066401e req-ff13778f-9df0-4bc8-bf5e-d790b5f5e8b3 service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-deleted-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] Acquiring lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] Lock "38f1b8c5-6ca7-45bd-89ae-460fc8db15de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] No waiting events found dispatching network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:42 user nova-compute[71026]: WARNING nova.compute.manager [req-38e7794e-3b61-4848-b0c4-ae381f255b71 req-db2fb484-66e2-4037-ad3e-7459af1db7cc service nova] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Received unexpected event network-vif-plugged-06a6d492-3332-47f2-996c-7401ac201108 for instance with vm_state deleted and task_state None.
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:05:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:05:44 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:05:44 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=7957MB free_disk=25.091522216796875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dc7eeb03-4739-485c-b7ce-3f2f8535921a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 337be0db-1456-4391-90c0-c6a5b75fc04a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:05:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing instance network info cache due to event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updated VIF entry in instance network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-95f0ed6e-47cc-4b61-8bb9-1fd296ad13bc req-059ae19a-ac5f-4c73-85df-a1265eb958b1 service nova] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:05:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:53 user nova-compute[71026]: INFO nova.compute.manager [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Shelving
Jul 27 17:05:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:54 user nova-compute[71026]: WARNING nova.compute.manager [req-10647489-177f-493a-be64-5117910e9f81 req-93033ae3-1c48-4acf-9e06-5d8f8a927405 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state active and task_state shelving.
Jul 27 17:05:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance destroyed successfully.
Jul 27 17:05:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:54 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Beginning cold snapshot process
Jul 27 17:05:54 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:05:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk /opt/stack/data/nova/instances/snapshots/tmp5sh8rp23/f8dc59033d714618ad848279a0eba1ae {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:05:55 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk /opt/stack/data/nova/instances/snapshots/tmp5sh8rp23/f8dc59033d714618ad848279a0eba1ae" returned: 0 in 0.584s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:05:55 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Snapshot extracted, beginning image upload
Jul 27 17:05:55 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477540.641151, 38f1b8c5-6ca7-45bd-89ae-460fc8db15de => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:05:55 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] VM Stopped (Lifecycle Event)
Jul 27 17:05:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4c2cf099-fc82-47c0-a8a3-436365dee2d3 None None] [instance: 38f1b8c5-6ca7-45bd-89ae-460fc8db15de] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:05:56 user nova-compute[71026]: WARNING nova.compute.manager [req-4830ce8e-c28b-4ea0-9225-c36118ad14d7 req-82e46a3b-7484-428c-bc49-d0fa6cd42239 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state active and task_state shelving_image_uploading.
Jul 27 17:05:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Snapshot image upload complete
Jul 27 17:05:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:57 user nova-compute[71026]: INFO nova.compute.manager [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Shelve offloading
Jul 27 17:05:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance destroyed successfully.
Jul 27 17:05:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:05:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:05:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:05:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:05:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance destroyed successfully.
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'resources' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjBb4WOywx/57jlmdpLXEfz/B/yawm7Z3KnXcgt1fOOQbXbWj7+c++K5B60UI/MjSIcqeb2c9aKlgshIB/+OeRb4IyF9Q76Dcow7CMATLtxEYzIV1HcoNXfyzx+/ztCng==',key_name='tempest-keypair-2030639588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T17:05:57.673496',shelved_host='user',shelved_image_id='81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG os_vif [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d39328f-51, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.compute.manager [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing instance network info cache due to event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG nova.network.neutron [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:05:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:05:58 user nova-compute[71026]: INFO os_vif [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51')
Jul 27 17:05:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Deleting instance files /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a_del
Jul 27 17:05:58 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Deletion of /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a_del complete
Jul 27 17:05:59 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Deleted allocations for instance dc7eeb03-4739-485c-b7ce-3f2f8535921a
Jul 27 17:05:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG nova.objects.instance [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'numa_topology' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG nova.network.neutron [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updated VIF entry in instance network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG nova.network.neutron [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d39328f-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-54da2481-ecb2-46b9-8f1e-13fc0189638d tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.616s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b90aeb0f-29eb-4468-b2bf-5766fc905072 req-1eb3a6d6-b757-4510-9391-f9aff4dedd8c service nova] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:05:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:06:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:05 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:06:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:06:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:09 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477554.6010602, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:06:09 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Stopped (Lifecycle Event)
Jul 27 17:06:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-02bf896e-50e1-42fb-aea5-496e2fed64b4 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:06:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-changed-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Refreshing instance network info cache due to event network-changed-9e51db72-bd9a-4ee7-98ab-a56779ef50c6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] Acquiring lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] Acquired lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Refreshing network info cache for port 9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:06:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Ignoring supplied device name: /dev/vdb
Jul 27 17:06:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:25 user nova-compute[71026]: INFO nova.compute.manager [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Attaching volume 233b4134-dd43-40a6-9766-a9c1ba461202 to /dev/vdb
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.utils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcbc90-51e9-4082-8e65-0c1eb9aed01e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d43119d-23eb-4bdf-a07a-f86b5cf0ac75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d954141a-e515-470d-8790-ad3ce2bcbbf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dca9f0f-6db8-4b58-b482-2a34cd82dd1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:06:25 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae835f3-8dd2-4c79-bb7f-8d5639005413]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG os_brick.utils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updating existing volume attachment record: 79550c3d-b125-41cb-ae0d-fad563cac43d {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updated VIF entry in instance network info cache for port 9e51db72-bd9a-4ee7-98ab-a56779ef50c6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updating instance_info_cache with network_info: [{"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:06:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3e3db88f-eadf-4d92-b153-ac5fbc1279fb req-d2443a20-5b54-490c-9d88-a7e387fb2a90 service nova] Releasing lock "refresh_cache-337be0db-1456-4391-90c0-c6a5b75fc04a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:06:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:35 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdQrklUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:06:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:06:36 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:06:36 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d760e5-2a6a-4e2a-9c02-15c67db5a0a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:06:36 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f6909-51bc-4dd0-922d-c8cca187344f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202] added
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be9233-b0cb-4bd0-a955-de738502a285]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca0950-f0f7-4d87-a79d-251334fdb344]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdQrklUG {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdQrklUG" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dbb852-bb7e-44a6-94a9-c07a49f281cd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdQrklUG'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7521c-fc92-4550-b883-658e03de5a90]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4887b4-b79c-4cf1-880e-70b223941e36]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aae9ab9-4587-426b-9a7c-5d58351fdf1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260]
Jul 27 17:06:36 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260] successful.
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29df98-0001-4b30-bf7a-080113ff9354]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d26008-7f6d-45f8-89c5-e564ea39fc30]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:06:36 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c5dac-f9ff-4fb3-8fbd-3171e842b58f]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:06:36 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdQrklUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23265643831386236', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265643831386236', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:06:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:06:37 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:06:37 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:06:37 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:06:37 user nova-compute[71026]:   <serial>233b4134-dd43-40a6-9766-a9c1ba461202</serial>
Jul 27 17:06:37 user nova-compute[71026]: </disk>
Jul 27 17:06:37 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:06:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:06:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:06:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No VIF found with MAC fa:16:3e:9b:5f:9b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:06:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-362c192d-2134-45f3-887c-1ac1b6c24695 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.177s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:39 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:06:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [{"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:06:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:06:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:06:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:06:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8198MB free_disk=25.166641235351562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 6e950d30-892f-471b-82d2-f435da94a63d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 337be0db-1456-4391-90c0-c6a5b75fc04a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:06:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing instance network info cache due to event network-changed-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] Acquiring lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] Acquired lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Refreshing network info cache for port 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:46 user nova-compute[71026]: INFO nova.compute.manager [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Terminating instance
Jul 27 17:06:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-unplugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] No waiting events found dispatching network-vif-unplugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-afd3831b-7ccb-4c0f-b48a-61a02ad814b3 req-e63717db-2559-4bd4-a8f5-28729da18fc9 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-unplugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updated VIF entry in instance network info cache for port 74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [{"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-98374bca-f313-4333-a098-d1d945b55dc3 req-ffe30222-9490-4315-9e1f-e896ccfc50d6 service nova] Releasing lock "refresh_cache-6e950d30-892f-471b-82d2-f435da94a63d" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:06:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Instance destroyed successfully.
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lazy-loading 'resources' on Instance uuid 6e950d30-892f-471b-82d2-f435da94a63d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:59:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-11091794',display_name='tempest-TestStampPattern-server-11091794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-11091794',id=38,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJb37HWp5nwEdyHo7UJ72CkloZt3iIcXJuiTH76pwVhX1tl1O1nEB3qO/pnM88PMRkTBPyBb0owlMldC2pcnHF6knsa3IPqc8u8iKHSmJW+AZvVOIicD6E5rxBCOyazlaw==',key_name='tempest-TestStampPattern-1952208613',keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='453f1bd5d8b347be913fe262b31a1c66',ramdisk_id='',reservation_id='r-52tjkuyb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-853432287',owner_user_name='tempest-TestStampPattern-853432287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:02:41Z,user_data=None,user_id='914c6d75846846a2b944bfb6111f0341',uuid=6e950d30-892f-471b-82d2-f435da94a63d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converting VIF {"id": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "address": "fa:16:3e:a1:2f:47", "network": {"id": "96ebdc73-c35b-4c30-b74d-100500b101d2", "bridge": "br-int", "label": "tempest-TestStampPattern-1350471941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "453f1bd5d8b347be913fe262b31a1c66", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ab015f-77", "ovs_interfaceid": "74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG os_vif [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74ab015f-77, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:47 user nova-compute[71026]: INFO os_vif [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:2f:47,bridge_name='br-int',has_traffic_filtering=True,id=74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8,network=Network(96ebdc73-c35b-4c30-b74d-100500b101d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ab015f-77')
Jul 27 17:06:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Deleting instance files /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d_del
Jul 27 17:06:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Deletion of /opt/stack/data/nova/instances/6e950d30-892f-471b-82d2-f435da94a63d_del complete
Jul 27 17:06:47 user nova-compute[71026]: INFO nova.compute.manager [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 17:06:47 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:06:47 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:06:48 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:06:48 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Took 0.49 seconds to deallocate network for instance.
Jul 27 17:06:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:48 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:06:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:06:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:48 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Deleted allocations for instance 6e950d30-892f-471b-82d2-f435da94a63d
Jul 27 17:06:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-05e093a8-4b1a-435b-8bcb-a8b36678baf7 tempest-TestStampPattern-853432287 tempest-TestStampPattern-853432287-project-member] Lock "6e950d30-892f-471b-82d2-f435da94a63d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.843s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] Acquiring lock "6e950d30-892f-471b-82d2-f435da94a63d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] Lock "6e950d30-892f-471b-82d2-f435da94a63d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:06:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] No waiting events found dispatching network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:06:49 user nova-compute[71026]: WARNING nova.compute.manager [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received unexpected event network-vif-plugged-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 for instance with vm_state deleted and task_state None.
Jul 27 17:06:49 user nova-compute[71026]: DEBUG nova.compute.manager [req-44ed67b1-3b8d-42fc-afcc-bc72097b1158 req-e3402b7f-634f-40f8-abbb-e8a35f98a6e7 service nova] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Received event network-vif-deleted-74ab015f-7745-4cf3-b7d6-f4f8a9d50eb8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:06:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:06:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:06:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:02 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477607.4101808, 6e950d30-892f-471b-82d2-f435da94a63d => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:07:02 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] VM Stopped (Lifecycle Event)
Jul 27 17:07:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-cf43111b-692b-4c09-bc89-10973da935ef None None] [instance: 6e950d30-892f-471b-82d2-f435da94a63d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:04 user nova-compute[71026]: INFO nova.compute.manager [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Terminating instance
Jul 27 17:07:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-45a89ebe-329c-4683-b59f-fe8df76e656b req-a6382601-d70e-4f5f-ac64-b5c0897350b7 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-unplugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Instance destroyed successfully.
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.objects.instance [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid 1d0485a3-06b6-4f95-972a-fadb9f03d235 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:01:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1818328519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1818328519',id=41,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:03:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-702fmsjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:05:18Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=1d0485a3-06b6-4f95-972a-fadb9f03d235,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "c051e627-8c47-4070-9b5c-f5f50420713a", "address": "fa:16:3e:86:76:3b", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc051e627-8c", "ovs_interfaceid": "c051e627-8c47-4070-9b5c-f5f50420713a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_vif [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc051e627-8c, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:05 user nova-compute[71026]: INFO os_vif [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:76:3b,bridge_name='br-int',has_traffic_filtering=True,id=c051e627-8c47-4070-9b5c-f5f50420713a,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc051e627-8c')
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbzYTZrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:07:05 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d34ec1-0374-4027-9177-d36981be29ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:07:05 user nova-compute[71026]: No targets found.
Jul 27 17:07:05 user nova-compute[71026]: iSNS:
Jul 27 17:07:05 user nova-compute[71026]: No targets found.
Jul 27 17:07:05 user nova-compute[71026]: STATIC:
Jul 27 17:07:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9
Jul 27 17:07:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202
Jul 27 17:07:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:05 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:07:05 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:05 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:05 user nova-compute[71026]: FIRMWARE:
Jul 27 17:07:05 user nova-compute[71026]: No targets found.
Jul 27 17:07:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:07:05 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:07:05 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45f1f4-db80-4da4-a5c3-1f224af68bca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00764ae-1bd1-4532-b136-2c8901dfeeab]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:05 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:07:05 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:07:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:05 user nova-compute[71026]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 (non-flash)
Jul 27 17:07:05 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:07:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885e8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9'): ({'sdd'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Removing single pathed devices sdd {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[409a83c5-d511-4cb7-bb73-51c24f1c7bfe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca352a1d-54b7-474c-bdc5-239de46c582c]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flushing IO for device /dev/sdd {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8bcaa-0da4-46bd-9154-6b2c4162895b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd37254-e7ef-454f-8981-7240dc028b2c]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] SCSI volumes sdd have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbcc8b-6903-4e9f-805b-8294058cfb05]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c256cf-d8aa-4d35-9ecf-85f314aab711]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260]
Jul 27 17:07:05 user nova-compute[71026]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9, portal: 172.16.0.220,3260] successful.
Jul 27 17:07:05 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58334e63-fa95-4139-8366-e6c3bfbebfa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7152fd65-57d5-474d-9cac-8a188b66ba73]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== disconnect_volume: return (362ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:07:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Deleting instance files /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235_del
Jul 27 17:07:05 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Deletion of /opt/stack/data/nova/instances/1d0485a3-06b6-4f95-972a-fadb9f03d235_del complete
Jul 27 17:07:05 user nova-compute[71026]: INFO nova.compute.manager [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 27 17:07:05 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:07:05 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:06 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Took 0.98 seconds to deallocate network for instance.
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-4e6cb73f-872f-4b46-a33a-a29129b59144 req-a0f7bc3b-86dc-45b5-b7b2-1a9fd5bb768c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-deleted-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:06 user nova-compute[71026]: INFO nova.compute.manager [req-4e6cb73f-872f-4b46-a33a-a29129b59144 req-a0f7bc3b-86dc-45b5-b7b2-1a9fd5bb768c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Neutron deleted interface c051e627-8c47-4070-9b5c-f5f50420713a; detaching it from the instance and deleting it from the info cache
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.network.neutron [req-4e6cb73f-872f-4b46-a33a-a29129b59144 req-a0f7bc3b-86dc-45b5-b7b2-1a9fd5bb768c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-4e6cb73f-872f-4b46-a33a-a29129b59144 req-a0f7bc3b-86dc-45b5-b7b2-1a9fd5bb768c service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Detach interface failed, port_id=c051e627-8c47-4070-9b5c-f5f50420713a, reason: Instance 1d0485a3-06b6-4f95-972a-fadb9f03d235 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] Acquiring lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:06 user nova-compute[71026]: DEBUG nova.compute.manager [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] No waiting events found dispatching network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:06 user nova-compute[71026]: WARNING nova.compute.manager [req-c6c004c8-40f0-4168-80b6-ff061cfbb8fe req-3f28bc30-8a08-4ba6-8543-c0978435dbf5 service nova] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Received unexpected event network-vif-plugged-c051e627-8c47-4070-9b5c-f5f50420713a for instance with vm_state active and task_state deleting.
Jul 27 17:07:07 user nova-compute[71026]: INFO nova.compute.manager [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Took 0.77 seconds to detach 1 volumes for instance.
Jul 27 17:07:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:07 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:07:07 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:07:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:07 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Deleted allocations for instance 1d0485a3-06b6-4f95-972a-fadb9f03d235
Jul 27 17:07:07 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-db5e1072-6e89-4bdc-84af-b95c2decafc8 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "1d0485a3-06b6-4f95-972a-fadb9f03d235" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.319s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:08 user nova-compute[71026]: INFO nova.compute.manager [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Detaching volume 233b4134-dd43-40a6-9766-a9c1ba461202
Jul 27 17:07:08 user nova-compute[71026]: INFO nova.virt.block_device [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Attempting to driver detach volume 233b4134-dd43-40a6-9766-a9c1ba461202 from mountpoint /dev/vdb
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Attempting to detach device vdb from instance 337be0db-1456-4391-90c0-c6a5b75fc04a from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:07:08 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:07:08 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:07:08 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:07:08 user nova-compute[71026]:   <serial>233b4134-dd43-40a6-9766-a9c1ba461202</serial>
Jul 27 17:07:08 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:07:08 user nova-compute[71026]: </disk>
Jul 27 17:07:08 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:07:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully detached device vdb from instance 337be0db-1456-4391-90c0-c6a5b75fc04a from the persistent domain config.
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 337be0db-1456-4391-90c0-c6a5b75fc04a from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:07:08 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:07:08 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:07:08 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:07:08 user nova-compute[71026]:   <serial>233b4134-dd43-40a6-9766-a9c1ba461202</serial>
Jul 27 17:07:08 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:07:08 user nova-compute[71026]: </disk>
Jul 27 17:07:08 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477628.6282618, 337be0db-1456-4391-90c0-c6a5b75fc04a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:07:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully detached device vdb from instance 337be0db-1456-4391-90c0-c6a5b75fc04a from the live domain config.
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdQrklUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:07:08 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09b719a-ce31-4ed9-98c9-9b5eb491036a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:07:08 user nova-compute[71026]: No targets found.
Jul 27 17:07:08 user nova-compute[71026]: iSNS:
Jul 27 17:07:08 user nova-compute[71026]: No targets found.
Jul 27 17:07:08 user nova-compute[71026]: STATIC:
Jul 27 17:07:08 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202
Jul 27 17:07:08 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:08 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:08 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:07:08 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:08 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:08 user nova-compute[71026]: FIRMWARE:
Jul 27 17:07:08 user nova-compute[71026]: No targets found.
Jul 27 17:07:08 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:07:08 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:07:08 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abddc6-8d19-4a1e-94de-32c5767df6b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f375a-a15d-466d-a80e-9cced29986b0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:08 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:07:08 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:08 user nova-compute[71026]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 (non-flash)
Jul 27 17:07:08 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30885415a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c955e6e-9ed5-4037-b5b4-61badb3b2399]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f5c2a-dc1e-4aa7-a149-55291e1cbd6e]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[964481f6-cfee-441f-a38a-33d9a27e9fd3]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[befaccce-b414-4bd6-9db4-d8315719b37d]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da92f9-5167-4690-b97b-c270292cfd5c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[87888e07-cae9-4b0f-95f2-fbc64ef929d6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260]
Jul 27 17:07:08 user nova-compute[71026]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202, portal: 172.16.0.220,3260] successful.
Jul 27 17:07:08 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce88e8d-8537-4666-aae3-5e52b931e424]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== disconnect_volume: return (282ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:07:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4b355040-78f7-4e96-a18e-a4d3ce64c326 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.461s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:09 user nova-compute[71026]: INFO nova.compute.manager [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Terminating instance
Jul 27 17:07:09 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-unplugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] No waiting events found dispatching network-vif-unplugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:09 user nova-compute[71026]: DEBUG nova.compute.manager [req-8a628242-cc3a-408e-9654-9459a0410a6f req-c6559f90-63c1-4178-9753-d967925310c5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-unplugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Instance destroyed successfully.
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'resources' on Instance uuid 337be0db-1456-4391-90c0-c6a5b75fc04a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-148043497',display_name='tempest-VolumesSnapshotTestJSON-instance-148043497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-148043497',id=44,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPIY0Qgd7Of3XCTQVcF2NXjh75k70x3eP1K0DTZxjaHgFoZBEtGgKEPJfPVSoERffRtWs2Aq6jIzodhhRjc4KY+m/IGM/maSTiEbGUOcmjxzB/sdL6SeEM4Psd+CyyamA==',key_name='tempest-keypair-1779694269',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-v32fcp6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=337be0db-1456-4391-90c0-c6a5b75fc04a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "address": "fa:16:3e:9b:5f:9b", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e51db72-bd", "ovs_interfaceid": "9e51db72-bd9a-4ee7-98ab-a56779ef50c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_vif [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e51db72-bd, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:10 user nova-compute[71026]: INFO os_vif [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:5f:9b,bridge_name='br-int',has_traffic_filtering=True,id=9e51db72-bd9a-4ee7-98ab-a56779ef50c6,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e51db72-bd')
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdQrklUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:07:10 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[83438c4a-9c3a-4467-b568-d880ef49d76c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:07:10 user nova-compute[71026]: No targets found.
Jul 27 17:07:10 user nova-compute[71026]: iSNS:
Jul 27 17:07:10 user nova-compute[71026]: No targets found.
Jul 27 17:07:10 user nova-compute[71026]: STATIC:
Jul 27 17:07:10 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:07:10 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:07:10 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:07:10 user nova-compute[71026]: FIRMWARE:
Jul 27 17:07:10 user nova-compute[71026]: No targets found.
Jul 27 17:07:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:07:10 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:07:10 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:233b4134-dd43-40a6-9766-a9c1ba461202', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab98346-32b9-4816-b128-3d4d0496209e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[89919fe4-d7eb-4441-8f9e-f48d62749307]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:07:10 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30b75535b0>, {}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Disconnecting from: [] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== disconnect_volume: return (73ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:07:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Deleting instance files /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a_del
Jul 27 17:07:10 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Deletion of /opt/stack/data/nova/instances/337be0db-1456-4391-90c0-c6a5b75fc04a_del complete
Jul 27 17:07:10 user nova-compute[71026]: INFO nova.compute.manager [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 27 17:07:10 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:07:10 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:07:11 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:11 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Took 0.94 seconds to deallocate network for instance.
Jul 27 17:07:11 user nova-compute[71026]: DEBUG nova.compute.manager [req-6f88d41b-6621-40ec-b93f-efacc4a59829 req-e5ae5229-af33-4706-8997-04ab6a61a195 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-deleted-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:11 user nova-compute[71026]: WARNING nova.volume.cinder [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Attachment 79550c3d-b125-41cb-ae0d-fad563cac43d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 79550c3d-b125-41cb-ae0d-fad563cac43d. (HTTP 404) (Request-ID: req-14bcfdeb-5a26-4c5a-9afc-9ca75d7170a6)
Jul 27 17:07:11 user nova-compute[71026]: INFO nova.compute.manager [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 17:07:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:11 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:07:11 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:07:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:11 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Deleted allocations for instance 337be0db-1456-4391-90c0-c6a5b75fc04a
Jul 27 17:07:11 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e39029c6-e584-4a1d-937d-32eacce676f6 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] Acquiring lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] Lock "337be0db-1456-4391-90c0-c6a5b75fc04a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] No waiting events found dispatching network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:12 user nova-compute[71026]: WARNING nova.compute.manager [req-e4cc94f8-a04c-446b-ac95-85953d543acb req-7f683481-0e34-42e5-8847-fcafa85f4dd5 service nova] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Received unexpected event network-vif-plugged-9e51db72-bd9a-4ee7-98ab-a56779ef50c6 for instance with vm_state deleted and task_state None.
Jul 27 17:07:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:20 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477625.2765615, 1d0485a3-06b6-4f95-972a-fadb9f03d235 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:07:20 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] VM Stopped (Lifecycle Event)
Jul 27 17:07:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-b906223b-76be-464f-81b5-95583f1eb89f None None] [instance: 1d0485a3-06b6-4f95-972a-fadb9f03d235] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:25 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477630.4791074, 337be0db-1456-4391-90c0-c6a5b75fc04a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:07:25 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] VM Stopped (Lifecycle Event)
Jul 27 17:07:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5716b485-e077-4858-8520-0292c376bacd None None] [instance: 337be0db-1456-4391-90c0-c6a5b75fc04a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:07:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:37 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:07:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [{"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-84e41b88-163b-46c2-8b8b-226afc0b3e1a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:07:42 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:07:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:07:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8507MB free_disk=25.220569610595703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:47 user nova-compute[71026]: INFO nova.compute.manager [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Unshelving
Jul 27 17:07:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_requests' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'numa_topology' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:07:47 user nova-compute[71026]: INFO nova.compute.claims [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Claim successful on node user
Jul 27 17:07:47 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:07:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:47 user nova-compute[71026]: INFO nova.network.neutron [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating port 8d39328f-51e8-4760-9f5d-7d52394b9ec6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing instance network info cache due to event network-changed-8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] Acquiring lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.network.neutron [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:07:48 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Creating image(s)
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] Acquired lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG nova.network.neutron [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Refreshing network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG nova.virt.images [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] 81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056 was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.part /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updated VIF entry in instance network info cache for port 8d39328f-51e8-4760-9f5d-7d52394b9ec6. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG nova.network.neutron [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0013b7ee-e9cf-431a-866b-0caf349d297b req-d7b16da6-8ce4-43fb-9a98-951a21b128c8 service nova] Releasing lock "refresh_cache-dc7eeb03-4739-485c-b7ce-3f2f8535921a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.part /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.converted" returned: 0 in 0.516s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.957s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json" returned: 0 in 0.160s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62,backing_fmt=raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62,backing_fmt=raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk 1073741824" returned: 0 in 0.069s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "c0a5b035e4b6f694fb49b286739a18e66f234f62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'migration_context' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:51 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Rebasing disk image.
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 -F raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 -F raw /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk" returned: 0 in 2.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Ensure instance console log exists: /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start _get_guest_xml network_info=[{"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d1f7e972bab5c247d90e614773fa6e24',container_format='bare',created_at=2023-07-27T17:05:54Z,direct_url=<?>,disk_format='qcow2',id=81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1577878567-shelved',owner='bebe60ded919474b85143cbe6d607ba5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T17:05:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:07:53 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:07:53 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d1f7e972bab5c247d90e614773fa6e24',container_format='bare',created_at=2023-07-27T17:05:54Z,direct_url=<?>,disk_format='qcow2',id=81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1577878567-shelved',owner='bebe60ded919474b85143cbe6d607ba5',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-27T17:05:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2030639588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T17:05:57.673496',shelved_host='user',shelved_image_id='81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'pci_devices' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:07:53 user nova-compute[71026]:   <uuid>dc7eeb03-4739-485c-b7ce-3f2f8535921a</uuid>
Jul 27 17:07:53 user nova-compute[71026]:   <name>instance-0000002b</name>
Jul 27 17:07:53 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:07:53 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:07:53 user nova-compute[71026]:   <metadata>
Jul 27 17:07:53 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:07:53 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1577878567</nova:name>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:07:53</nova:creationTime>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:07:53 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:07:53 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:owner>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:user uuid="62e60e4b7b164fc19a1d932799eca227">tempest-AttachVolumeShelveTestJSON-576960083-project-member</nova:user>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:project uuid="bebe60ded919474b85143cbe6d607ba5">tempest-AttachVolumeShelveTestJSON-576960083</nova:project>
Jul 27 17:07:53 user nova-compute[71026]:       </nova:owner>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:root type="image" uuid="81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056"/>
Jul 27 17:07:53 user nova-compute[71026]:       <nova:ports>
Jul 27 17:07:53 user nova-compute[71026]:         <nova:port uuid="8d39328f-51e8-4760-9f5d-7d52394b9ec6">
Jul 27 17:07:53 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 17:07:53 user nova-compute[71026]:         </nova:port>
Jul 27 17:07:53 user nova-compute[71026]:       </nova:ports>
Jul 27 17:07:53 user nova-compute[71026]:     </nova:instance>
Jul 27 17:07:53 user nova-compute[71026]:   </metadata>
Jul 27 17:07:53 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:07:53 user nova-compute[71026]:     <system>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="serial">dc7eeb03-4739-485c-b7ce-3f2f8535921a</entry>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="uuid">dc7eeb03-4739-485c-b7ce-3f2f8535921a</entry>
Jul 27 17:07:53 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:07:53 user nova-compute[71026]:     </system>
Jul 27 17:07:53 user nova-compute[71026]:   </sysinfo>
Jul 27 17:07:53 user nova-compute[71026]:   <os>
Jul 27 17:07:53 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:07:53 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:07:53 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:07:53 user nova-compute[71026]:   </os>
Jul 27 17:07:53 user nova-compute[71026]:   <features>
Jul 27 17:07:53 user nova-compute[71026]:     <acpi/>
Jul 27 17:07:53 user nova-compute[71026]:     <apic/>
Jul 27 17:07:53 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:07:53 user nova-compute[71026]:   </features>
Jul 27 17:07:53 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:07:53 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:07:53 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:07:53 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:07:53 user nova-compute[71026]:   </clock>
Jul 27 17:07:53 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:07:53 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:07:53 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:07:53 user nova-compute[71026]:   </cpu>
Jul 27 17:07:53 user nova-compute[71026]:   <devices>
Jul 27 17:07:53 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:07:53 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:07:53 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk"/>
Jul 27 17:07:53 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:07:53 user nova-compute[71026]:     </disk>
Jul 27 17:07:53 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:07:53 user nova-compute[71026]:       <mac address="fa:16:3e:5a:cb:27"/>
Jul 27 17:07:53 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:07:53 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:07:53 user nova-compute[71026]:       <target dev="tap8d39328f-51"/>
Jul 27 17:07:53 user nova-compute[71026]:     </interface>
Jul 27 17:07:53 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:07:53 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/console.log" append="off"/>
Jul 27 17:07:53 user nova-compute[71026]:     </serial>
Jul 27 17:07:53 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:07:53 user nova-compute[71026]:     <video>
Jul 27 17:07:53 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:07:53 user nova-compute[71026]:     </video>
Jul 27 17:07:53 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:07:53 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:07:53 user nova-compute[71026]:     </rng>
Jul 27 17:07:53 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:07:53 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:07:53 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:07:53 user nova-compute[71026]:     </memballoon>
Jul 27 17:07:53 user nova-compute[71026]:   </devices>
Jul 27 17:07:53 user nova-compute[71026]: </domain>
Jul 27 17:07:53 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2030639588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member',shelved_at='2023-07-27T17:05:57.673496',shelved_host='user',shelved_image_id='81d7fd7a-4a3f-4ec6-8239-e6bd08f5a056'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG os_vif [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d39328f-51, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d39328f-51, col_values=(('external_ids', {'iface-id': '8d39328f-51e8-4760-9f5d-7d52394b9ec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:cb:27', 'vm-uuid': 'dc7eeb03-4739-485c-b7ce-3f2f8535921a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:53 user nova-compute[71026]: INFO os_vif [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51')
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:07:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] No VIF found with MAC fa:16:3e:5a:cb:27, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:55 user nova-compute[71026]: INFO nova.compute.manager [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Terminating instance
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-unplugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] No waiting events found dispatching network-vif-unplugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-2de3349b-381c-4545-b3e6-3ed86d1761dd req-7141501a-4c82-4acf-8acc-b1b70cbf550f service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-unplugged-19bb9e91-7f88-46a5-a416-85c294b49646 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:55 user nova-compute[71026]: DEBUG nova.compute.manager [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:55 user nova-compute[71026]: WARNING nova.compute.manager [req-4a728ad6-07ec-4e1c-8d98-b588450eda4d req-adf127fe-72a3-4083-9dbc-40e8a9d24616 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Instance destroyed successfully.
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.objects.instance [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid 4a661cd6-8dfb-4266-a5ca-cea210c9080a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1763282222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1763282222',id=37,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-4nfjhr5h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:00:30Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=4a661cd6-8dfb-4266-a5ca-cea210c9080a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "19bb9e91-7f88-46a5-a416-85c294b49646", "address": "fa:16:3e:ae:44:84", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19bb9e91-7f", "ovs_interfaceid": "19bb9e91-7f88-46a5-a416-85c294b49646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG os_vif [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19bb9e91-7f, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:07:56 user nova-compute[71026]: INFO os_vif [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:44:84,bridge_name='br-int',has_traffic_filtering=True,id=19bb9e91-7f88-46a5-a416-85c294b49646,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19bb9e91-7f')
Jul 27 17:07:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Deleting instance files /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a_del
Jul 27 17:07:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Deletion of /opt/stack/data/nova/instances/4a661cd6-8dfb-4266-a5ca-cea210c9080a_del complete
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: INFO nova.compute.manager [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 27 17:07:56 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:07:56 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Took 0.57 seconds to deallocate network for instance.
Jul 27 17:07:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Deleted allocations for instance 4a661cd6-8dfb-4266-a5ca-cea210c9080a
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-57f686a4-1b28-487f-b6c7-7510731d3928 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] Acquiring lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] Lock "4a661cd6-8dfb-4266-a5ca-cea210c9080a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] No waiting events found dispatching network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:57 user nova-compute[71026]: WARNING nova.compute.manager [req-51587d01-2dca-4f6f-9445-558420482289 req-b68f0b3b-44c1-4820-a3d9-415dfa4756d7 service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received unexpected event network-vif-plugged-19bb9e91-7f88-46a5-a416-85c294b49646 for instance with vm_state deleted and task_state None.
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:07:57 user nova-compute[71026]: WARNING nova.compute.manager [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [req-49b27eaa-34fc-47b7-bdb1-2bffb505d75c req-d9407a38-6a53-4e72-95e3-b94055b9233b service nova] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Received event network-vif-deleted-19bb9e91-7f88-46a5-a416-85c294b49646 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477677.8854034, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Resumed (Lifecycle Event)
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance spawned successfully.
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477677.886464, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Started (Lifecycle Event)
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:07:57 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:07:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:07:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1f875f12-1614-4d52-bb02-a4539aed9401 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.262s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:07:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477676.1324468, 4a661cd6-8dfb-4266-a5ca-cea210c9080a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:08:11 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] VM Stopped (Lifecycle Event)
Jul 27 17:08:11 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6eb485a9-0ea6-40ef-86ac-c0e8890c1039 None None] [instance: 4a661cd6-8dfb-4266-a5ca-cea210c9080a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:08:21 user nova-compute[71026]: INFO nova.compute.claims [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Claim successful on node user
Jul 27 17:08:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:08:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.policy [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27622507ef1240d9adf5d005035e2bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9953dd1d0240c8876b8235e47740de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:08:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Creating image(s)
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "/opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "/opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.131s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk 1073741824" returned: 0 in 0.048s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Successfully created port: 4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Cannot resize image /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'migration_context' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Ensure instance console log exists: /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Successfully updated port: 4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquired lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:08:22 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-changed-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Refreshing instance network info cache due to event network-changed-4f782c40-4fca-4882-900d-43e63f15cd9a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] Acquiring lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Releasing lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Instance network_info: |[{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] Acquired lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Refreshing network info cache for port 4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Start _get_guest_xml network_info=[{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:08:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:08:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-19456454',display_name='tempest-VolumesSnapshotTestJSON-instance-19456454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-19456454',id=45,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPuUXxlPoqELM6ccYZX+OBLyOOzy8yGXIRbyoYpfpd9XlY3iQIeY4yKJFGayWz5JrcPDmeXMgFplZedDFPfNkzSGJE+PUj09Ytl+Wm76MIcxzzNUS3TG7v8nq6ov/QZdA==',key_name='tempest-keypair-2087577319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-pynpiz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=bb04bc7c-ab87-467d-816a-2753b42944af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'pci_devices' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:08:23 user nova-compute[71026]:   <uuid>bb04bc7c-ab87-467d-816a-2753b42944af</uuid>
Jul 27 17:08:23 user nova-compute[71026]:   <name>instance-0000002d</name>
Jul 27 17:08:23 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:08:23 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:08:23 user nova-compute[71026]:   <metadata>
Jul 27 17:08:23 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:08:23 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-19456454</nova:name>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:08:23</nova:creationTime>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:08:23 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:08:23 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:owner>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:user uuid="27622507ef1240d9adf5d005035e2bc9">tempest-VolumesSnapshotTestJSON-270009591-project-member</nova:user>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:project uuid="fd9953dd1d0240c8876b8235e47740de">tempest-VolumesSnapshotTestJSON-270009591</nova:project>
Jul 27 17:08:23 user nova-compute[71026]:       </nova:owner>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:08:23 user nova-compute[71026]:       <nova:ports>
Jul 27 17:08:23 user nova-compute[71026]:         <nova:port uuid="4f782c40-4fca-4882-900d-43e63f15cd9a">
Jul 27 17:08:23 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 17:08:23 user nova-compute[71026]:         </nova:port>
Jul 27 17:08:23 user nova-compute[71026]:       </nova:ports>
Jul 27 17:08:23 user nova-compute[71026]:     </nova:instance>
Jul 27 17:08:23 user nova-compute[71026]:   </metadata>
Jul 27 17:08:23 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:08:23 user nova-compute[71026]:     <system>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="serial">bb04bc7c-ab87-467d-816a-2753b42944af</entry>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="uuid">bb04bc7c-ab87-467d-816a-2753b42944af</entry>
Jul 27 17:08:23 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:08:23 user nova-compute[71026]:     </system>
Jul 27 17:08:23 user nova-compute[71026]:   </sysinfo>
Jul 27 17:08:23 user nova-compute[71026]:   <os>
Jul 27 17:08:23 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:08:23 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:08:23 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:08:23 user nova-compute[71026]:   </os>
Jul 27 17:08:23 user nova-compute[71026]:   <features>
Jul 27 17:08:23 user nova-compute[71026]:     <acpi/>
Jul 27 17:08:23 user nova-compute[71026]:     <apic/>
Jul 27 17:08:23 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:08:23 user nova-compute[71026]:   </features>
Jul 27 17:08:23 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:08:23 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:08:23 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:08:23 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:08:23 user nova-compute[71026]:   </clock>
Jul 27 17:08:23 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:08:23 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:08:23 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:08:23 user nova-compute[71026]:   </cpu>
Jul 27 17:08:23 user nova-compute[71026]:   <devices>
Jul 27 17:08:23 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:08:23 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:08:23 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk"/>
Jul 27 17:08:23 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:08:23 user nova-compute[71026]:     </disk>
Jul 27 17:08:23 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:08:23 user nova-compute[71026]:       <mac address="fa:16:3e:e0:04:38"/>
Jul 27 17:08:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:08:23 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:08:23 user nova-compute[71026]:       <target dev="tap4f782c40-4f"/>
Jul 27 17:08:23 user nova-compute[71026]:     </interface>
Jul 27 17:08:23 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:08:23 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/console.log" append="off"/>
Jul 27 17:08:23 user nova-compute[71026]:     </serial>
Jul 27 17:08:23 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:08:23 user nova-compute[71026]:     <video>
Jul 27 17:08:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:08:23 user nova-compute[71026]:     </video>
Jul 27 17:08:23 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:08:23 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:08:23 user nova-compute[71026]:     </rng>
Jul 27 17:08:23 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:08:23 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:08:23 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:08:23 user nova-compute[71026]:     </memballoon>
Jul 27 17:08:23 user nova-compute[71026]:   </devices>
Jul 27 17:08:23 user nova-compute[71026]: </domain>
Jul 27 17:08:23 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-19456454',display_name='tempest-VolumesSnapshotTestJSON-instance-19456454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-19456454',id=45,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPuUXxlPoqELM6ccYZX+OBLyOOzy8yGXIRbyoYpfpd9XlY3iQIeY4yKJFGayWz5JrcPDmeXMgFplZedDFPfNkzSGJE+PUj09Ytl+Wm76MIcxzzNUS3TG7v8nq6ov/QZdA==',key_name='tempest-keypair-2087577319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-pynpiz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=bb04bc7c-ab87-467d-816a-2753b42944af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG os_vif [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f782c40-4f, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f782c40-4f, col_values=(('external_ids', {'iface-id': '4f782c40-4fca-4882-900d-43e63f15cd9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:04:38', 'vm-uuid': 'bb04bc7c-ab87-467d-816a-2753b42944af'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:23 user nova-compute[71026]: INFO os_vif [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f')
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:08:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No VIF found with MAC fa:16:3e:e0:04:38, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:08:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updated VIF entry in instance network info cache for port 4f782c40-4fca-4882-900d-43e63f15cd9a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:08:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:08:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe28d924-4913-45ec-9230-d8ee75a77232 req-20310711-031e-4c1c-a65e-6a232ab67d80 service nova] Releasing lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:08:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] No waiting events found dispatching network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:08:25 user nova-compute[71026]: WARNING nova.compute.manager [req-94fa684f-a882-457e-b7ec-bfcf28a29dcf req-84acabbd-3458-4ae9-9d1f-e407346242b9 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received unexpected event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a for instance with vm_state building and task_state spawning.
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477707.177105, bb04bc7c-ab87-467d-816a-2753b42944af => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] VM Resumed (Lifecycle Event)
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Instance spawned successfully.
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477707.180295, bb04bc7c-ab87-467d-816a-2753b42944af => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] VM Started (Lifecycle Event)
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Took 5.67 seconds to spawn the instance on the hypervisor.
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:08:27 user nova-compute[71026]: INFO nova.compute.manager [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Took 6.24 seconds to build instance.
Jul 27 17:08:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-07625e1a-93b4-40b0-8a47-0148edb6b2b2 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.349s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] No waiting events found dispatching network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:08:27 user nova-compute[71026]: WARNING nova.compute.manager [req-fc7aa674-5189-4537-a3e8-e209109b578b req-a2144801-7c3a-441f-9554-e95b2d76dec0 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received unexpected event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a for instance with vm_state active and task_state None.
Jul 27 17:08:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:08:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:42 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:44 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:08:44 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.291236877441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance dc7eeb03-4739-485c-b7ce-3f2f8535921a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bb04bc7c-ab87-467d-816a-2753b42944af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:08:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:45 user nova-compute[71026]: INFO nova.compute.manager [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Terminating instance
Jul 27 17:08:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.compute.manager [req-55e3607a-9774-4a3e-a59b-181e94d894d7 req-7cbe4866-ae8a-4a34-8beb-5505dde18f74 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-unplugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Instance destroyed successfully.
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid 84e41b88-163b-46c2-8b8b-226afc0b3e1a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:52:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-157991698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-157991698',id=30,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:54:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-zfdb5cji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:56:48Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=84e41b88-163b-46c2-8b8b-226afc0b3e1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "fcc5b255-cc94-4709-9763-1af6e20033f5", "address": "fa:16:3e:58:d2:a5", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcc5b255-cc", "ovs_interfaceid": "fcc5b255-cc94-4709-9763-1af6e20033f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_vif [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcc5b255-cc, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:08:46 user nova-compute[71026]: INFO os_vif [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:d2:a5,bridge_name='br-int',has_traffic_filtering=True,id=fcc5b255-cc94-4709-9763-1af6e20033f5,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcc5b255-cc')
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LWjtiMeE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:08:46 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[41017791-2b1d-4f18-9c7d-20e8c619c188]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:08:46 user nova-compute[71026]: No targets found.
Jul 27 17:08:46 user nova-compute[71026]: iSNS:
Jul 27 17:08:46 user nova-compute[71026]: No targets found.
Jul 27 17:08:46 user nova-compute[71026]: STATIC:
Jul 27 17:08:46 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f
Jul 27 17:08:46 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:08:46 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:08:46 user nova-compute[71026]: FIRMWARE:
Jul 27 17:08:46 user nova-compute[71026]: No targets found.
Jul 27 17:08:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:08:46 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:08:46 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81715f-100c-4312-b14c-5a799cc387c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247b67c-967a-480f-b833-95eeac9b74d4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:08:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f (non-flash)
Jul 27 17:08:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f308816beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52adace5-545e-4045-bbc6-8119a6b1930f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe98e47-7ab8-4080-a139-08515e6eec5d]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[139150a6-f2e5-45f0-8378-d349d39a4554]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1783c31f-7003-45c0-a1b5-7b5469017daf]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2fbdd0-c0bf-433b-8589-8ff953ac38da]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286dfd4-4c9f-4e3f-95cb-4b1d8055cb69]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260]
Jul 27 17:08:46 user nova-compute[71026]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f, portal: 172.16.0.220,3260] successful.
Jul 27 17:08:46 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d55e1351-28e7-4ede-9e8c-6956f9b9068f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94c574-f53e-4ef3-84e3-3e180e29a6b6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] <== disconnect_volume: return (262ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:08:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Deleting instance files /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a_del
Jul 27 17:08:46 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Deletion of /opt/stack/data/nova/instances/84e41b88-163b-46c2-8b8b-226afc0b3e1a_del complete
Jul 27 17:08:46 user nova-compute[71026]: INFO nova.compute.manager [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 27 17:08:46 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:08:46 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:08:47 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:08:47 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Took 0.43 seconds to deallocate network for instance.
Jul 27 17:08:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-e90f387a-ecdf-402a-be6d-c688a4393713 req-e5970530-dcaa-49e5-b3b5-dff1bae2a1a4 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-deleted-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:47 user nova-compute[71026]: INFO nova.compute.manager [req-e90f387a-ecdf-402a-be6d-c688a4393713 req-e5970530-dcaa-49e5-b3b5-dff1bae2a1a4 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Neutron deleted interface fcc5b255-cc94-4709-9763-1af6e20033f5; detaching it from the instance and deleting it from the info cache
Jul 27 17:08:47 user nova-compute[71026]: DEBUG nova.network.neutron [req-e90f387a-ecdf-402a-be6d-c688a4393713 req-e5970530-dcaa-49e5-b3b5-dff1bae2a1a4 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:08:47 user nova-compute[71026]: DEBUG nova.compute.manager [req-e90f387a-ecdf-402a-be6d-c688a4393713 req-e5970530-dcaa-49e5-b3b5-dff1bae2a1a4 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Detach interface failed, port_id=fcc5b255-cc94-4709-9763-1af6e20033f5, reason: Instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:08:48 user nova-compute[71026]: INFO nova.compute.manager [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Took 0.76 seconds to detach 1 volumes for instance.
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] Acquiring lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] No waiting events found dispatching network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:08:48 user nova-compute[71026]: WARNING nova.compute.manager [req-9fa9a7f1-df82-4c85-b9e4-c7aa48c20b9f req-abb8381a-f9fd-4308-bcc4-d085c81e98a2 service nova] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Received unexpected event network-vif-plugged-fcc5b255-cc94-4709-9763-1af6e20033f5 for instance with vm_state deleted and task_state None.
Jul 27 17:08:48 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:48 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Deleted allocations for instance 84e41b88-163b-46c2-8b8b-226afc0b3e1a
Jul 27 17:08:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-e23b5809-7699-4f4c-8508-7933b25511fe tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "84e41b88-163b-46c2-8b8b-226afc0b3e1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:08:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:08:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:08:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477726.5379887, 84e41b88-163b-46c2-8b8b-226afc0b3e1a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:09:01 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] VM Stopped (Lifecycle Event)
Jul 27 17:09:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-57d3a3e2-d482-4761-a5f2-8d587b484edc None None] [instance: 84e41b88-163b-46c2-8b8b-226afc0b3e1a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:09:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:36 user nova-compute[71026]: INFO nova.compute.manager [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Terminating instance
Jul 27 17:09:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-unplugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] No waiting events found dispatching network-vif-unplugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:09:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-a3f35aee-9ff3-4265-80b1-f02378041bf5 req-c23c716d-b59d-4aae-95ee-f76c6e06fc4c service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-unplugged-219bf895-df64-440d-b1a0-7af19c96508d for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:09:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Instance destroyed successfully.
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lazy-loading 'resources' on Instance uuid dba932d6-68a1-495f-a7bb-3a9a4bd34a1d {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T16:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1999494908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1999494908',id=28,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-27T16:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cbbd8fb9af44b38b4c48be901f137a0',ramdisk_id='',reservation_id='r-r28rr6so',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-996401610',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T16:51:58Z,user_data=None,user_id='0c742ca26757400288ef69caac251d91',uuid=dba932d6-68a1-495f-a7bb-3a9a4bd34a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converting VIF {"id": "219bf895-df64-440d-b1a0-7af19c96508d", "address": "fa:16:3e:0c:04:34", "network": {"id": "a114c15f-c856-4d90-a758-da18314037dd", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1312179834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cbbd8fb9af44b38b4c48be901f137a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap219bf895-df", "ovs_interfaceid": "219bf895-df64-440d-b1a0-7af19c96508d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG os_vif [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap219bf895-df, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:09:37 user nova-compute[71026]: INFO os_vif [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:04:34,bridge_name='br-int',has_traffic_filtering=True,id=219bf895-df64-440d-b1a0-7af19c96508d,network=Network(a114c15f-c856-4d90-a758-da18314037dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap219bf895-df')
Jul 27 17:09:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Deleting instance files /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d_del
Jul 27 17:09:37 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Deletion of /opt/stack/data/nova/instances/dba932d6-68a1-495f-a7bb-3a9a4bd34a1d_del complete
Jul 27 17:09:37 user nova-compute[71026]: INFO nova.compute.manager [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:37 user nova-compute[71026]: INFO nova.compute.manager [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Terminating instance
Jul 27 17:09:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-10b009a8-8b2a-47a2-9318-b1e3f1a1a293 req-8ae9eb1d-915b-4806-8dd7-18e1735e197e service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-unplugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Instance destroyed successfully.
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lazy-loading 'resources' on Instance uuid dc7eeb03-4739-485c-b7ce-3f2f8535921a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-27T17:03:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1577878567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1577878567',id=43,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjBb4WOywx/57jlmdpLXEfz/B/yawm7Z3KnXcgt1fOOQbXbWj7+c++K5B60UI/MjSIcqeb2c9aKlgshIB/+OeRb4IyF9Q76Dcow7CMATLtxEYzIV1HcoNXfyzx+/ztCng==',key_name='tempest-keypair-2030639588',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bebe60ded919474b85143cbe6d607ba5',ramdisk_id='',reservation_id='r-a2adydb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-576960083',owner_user_name='tempest-AttachVolumeShelveTestJSON-576960083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62e60e4b7b164fc19a1d932799eca227',uuid=dc7eeb03-4739-485c-b7ce-3f2f8535921a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converting VIF {"id": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "address": "fa:16:3e:5a:cb:27", "network": {"id": "e501e79d-b718-47a5-baa8-1a75d25ae044", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-766381544-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bebe60ded919474b85143cbe6d607ba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d39328f-51", "ovs_interfaceid": "8d39328f-51e8-4760-9f5d-7d52394b9ec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG os_vif [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d39328f-51, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:09:38 user nova-compute[71026]: INFO os_vif [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:cb:27,bridge_name='br-int',has_traffic_filtering=True,id=8d39328f-51e8-4760-9f5d-7d52394b9ec6,network=Network(e501e79d-b718-47a5-baa8-1a75d25ae044),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d39328f-51')
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Deleting instance files /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a_del
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Deletion of /opt/stack/data/nova/instances/dc7eeb03-4739-485c-b7ce-3f2f8535921a_del complete
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.compute.manager [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Took 1.11 seconds to deallocate network for instance.
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:38 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Deleted allocations for instance dba932d6-68a1-495f-a7bb-3a9a4bd34a1d
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] Acquiring lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:38 user nova-compute[71026]: DEBUG nova.compute.manager [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] No waiting events found dispatching network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:09:38 user nova-compute[71026]: WARNING nova.compute.manager [req-686f393a-3bfc-4e76-aa14-c603e7518108 req-712f788e-bbac-478a-b4ed-a1a56966c534 service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received unexpected event network-vif-plugged-219bf895-df64-440d-b1a0-7af19c96508d for instance with vm_state deleted and task_state None.
Jul 27 17:09:38 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-c4ab01c1-dafe-4189-a10a-1241a69c1898 tempest-ServerBootFromVolumeStableRescueTest-996401610 tempest-ServerBootFromVolumeStableRescueTest-996401610-project-member] Lock "dba932d6-68a1-495f-a7bb-3a9a4bd34a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.426s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:09:39 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Took 1.05 seconds to deallocate network for instance.
Jul 27 17:09:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:39 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Deleted allocations for instance dc7eeb03-4739-485c-b7ce-3f2f8535921a
Jul 27 17:09:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7260c44b-e242-47bc-ac72-b8f14be56075 tempest-AttachVolumeShelveTestJSON-576960083 tempest-AttachVolumeShelveTestJSON-576960083-project-member] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Received event network-vif-deleted-219bf895-df64-440d-b1a0-7af19c96508d {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] Acquiring lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] Lock "dc7eeb03-4739-485c-b7ce-3f2f8535921a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] No waiting events found dispatching network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:09:40 user nova-compute[71026]: WARNING nova.compute.manager [req-289150ed-4068-460c-be4b-48dab57e40a5 req-58126628-0a11-45a7-b9f9-3c63d78df9fc service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received unexpected event network-vif-plugged-8d39328f-51e8-4760-9f5d-7d52394b9ec6 for instance with vm_state deleted and task_state None.
Jul 27 17:09:40 user nova-compute[71026]: DEBUG nova.compute.manager [req-104efadd-120b-44fd-849e-a70d77d9e8b0 req-b0a48486-aa25-4999-8c01-4998e1991c29 service nova] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Received event network-vif-deleted-8d39328f-51e8-4760-9f5d-7d52394b9ec6 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:09:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:09:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:09:43 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:09:44 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.44168472290039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bb04bc7c-ab87-467d-816a-2753b42944af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:09:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:45 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:09:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:09:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:52 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477777.337313, dba932d6-68a1-495f-a7bb-3a9a4bd34a1d => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:09:52 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] VM Stopped (Lifecycle Event)
Jul 27 17:09:52 user nova-compute[71026]: DEBUG nova.compute.manager [None req-97a236c6-da9c-41ec-8bdd-f5ced5cd1c50 None None] [instance: dba932d6-68a1-495f-a7bb-3a9a4bd34a1d] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:09:53 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477778.345696, dc7eeb03-4739-485c-b7ce-3f2f8535921a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:09:53 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] VM Stopped (Lifecycle Event)
Jul 27 17:09:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-3c543775-8c95-4fdd-b2dd-fd4927cc9a44 None None] [instance: dc7eeb03-4739-485c-b7ce-3f2f8535921a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:09:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:09:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:09:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:10:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Verify base images {{(pid=71026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Image id 25ab5798-ce67-493f-a351-9c5665bf837e yields fingerprint 474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 {{(pid=71026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] image 25ab5798-ce67-493f-a351-9c5665bf837e at (/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1): checking
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] image 25ab5798-ce67-493f-a351-9c5665bf837e at (/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1): image is in use {{(pid=71026) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] bb04bc7c-ab87-467d-816a-2753b42944af is a valid instance name {{(pid=71026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] bb04bc7c-ab87-467d-816a-2753b42944af has a disk file {{(pid=71026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bb04bc7c-ab87-467d-816a-2753b42944af is backed by 474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 {{(pid=71026) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6
Jul 27 17:10:08 user nova-compute[71026]: WARNING nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Unknown base file: /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Active base files: /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Removable base files: /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62 /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603 /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6 /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c0a5b035e4b6f694fb49b286739a18e66f234f62
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bc7a350a16ee2c68a09bceb9df98558b32afa603
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/56b60ef71181e8544d0591e3429fac84fb7b09fc
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e9d87b1abd81a228e0813a77c4762348cbf4855d
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7ae450de7d32bdc03f5dbc21e717a5cd31525c1d
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/259b2d5081d213cf375a772959e4f811adf047e6
Jul 27 17:10:08 user nova-compute[71026]: INFO nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/59379ec23c3fbbcc20ff4ffd96c92cc8a86ab795
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Verification complete {{(pid=71026) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Verify swap images {{(pid=71026) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.imagecache [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Verify ephemeral images {{(pid=71026) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 27 17:10:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-changed-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Refreshing instance network info cache due to event network-changed-4f782c40-4fca-4882-900d-43e63f15cd9a. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] Acquiring lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] Acquired lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Refreshing network info cache for port 4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Ignoring supplied device name: /dev/vdb
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updated VIF entry in instance network info cache for port 4f782c40-4fca-4882-900d-43e63f15cd9a. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG nova.network.neutron [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d967c782-e68d-46b4-99e3-7e89badcc83b req-7ef8b350-59b1-4d1f-b2b0-cc482009cbb1 service nova] Releasing lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:12 user nova-compute[71026]: INFO nova.compute.manager [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Attaching volume c75a23f9-ee84-408c-8cc1-de6edfa557e9 to /dev/vdb
Jul 27 17:10:12 user nova-compute[71026]: DEBUG os_brick.utils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99e1529-ef64-49ee-962b-88ce4b1c65ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c727efb-c996-44fe-bd8c-0c84bd6e2fd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc997c-889b-46ec-993b-4e51bb172eff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ae4a9-36de-4d5e-96a2-13fd0c4f094e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:10:13 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:10:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3101ae-d3c9-48cf-9dd6-6d5fc6d11a58]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG os_brick.utils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating existing volume attachment record: 520a9131-07b1-452a-81af-6377d552feeb {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:10:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:10:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbFBOroJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:10:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:10:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:10:19 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc76cb-57e1-4dd3-aba7-d1977e46bd73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:10:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec331e-0626-43fb-9610-f081e7df7570]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9] added
Jul 27 17:10:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16351e9c-fa23-42e2-86f7-6f3beebd79dd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b58bfd-9cfb-4492-97bc-a817dd8eaacd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbFBOroJ {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbFBOroJ" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d1d80-6f5f-493b-97ff-8676fb5cbf69]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbFBOroJ'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53834178-8b28-40b3-adc9-f9db152d81c6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3067151f-3f2a-4568-b6d2-e07a9eec74ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:10:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:10:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:10:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 17:10:19 user nova-compute[71026]: 
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4e1ee0-a53d-43d2-88d2-e17ff5537112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260]
Jul 27 17:10:19 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260] successful.
Jul 27 17:10:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[598bc92c-558d-4400-912e-7f1317edba78]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5de3f-1164-4616-8bad-16689a747154]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)
Jul 27 17:10:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)
Jul 27 17:10:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20eb8a-0100-4977-9eff-d8d57dac662a]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:19 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbFBOroJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26434643566633763', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434643566633763', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:10:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:10:21 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:10:21 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:10:21 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:10:21 user nova-compute[71026]:   <serial>c75a23f9-ee84-408c-8cc1-de6edfa557e9</serial>
Jul 27 17:10:21 user nova-compute[71026]: </disk>
Jul 27 17:10:21 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:10:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:10:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:10:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] No VIF found with MAC fa:16:3e:e0:04:38, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:10:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-2f0f897d-0cff-4418-929d-4c45a410af8e tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.675s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:41 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:42 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:10:42 user nova-compute[71026]: INFO nova.compute.claims [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Claim successful on node user
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:10:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:10:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Creating image(s)
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "/opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.policy [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32fb8f31ad924af19499c72671d0cfd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755fc60deefd4468a017742d1a5f922e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk 1073741824" returned: 0 in 0.049s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.164s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Cannot resize image /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.objects.instance [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'migration_context' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Ensure instance console log exists: /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:44 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Successfully created port: fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:10:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Successfully updated port: fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquired lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-changed-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.compute.manager [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Refreshing instance network info cache due to event network-changed-fcf3840c-4db8-454e-b31b-9feaf6750cda. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] Acquiring lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:10:45 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:10:45 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.430992126464844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:45 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance bb04bc7c-ab87-467d-816a-2753b42944af actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Releasing lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Instance network_info: |[{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] Acquired lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Refreshing network info cache for port fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Start _get_guest_xml network_info=[{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:10:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:10:46 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518504960',display_name='tempest-AttachVolumeNegativeTest-server-1518504960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1518504960',id=46,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbvoHxjoYHTFqJ9ySlGs9RiCXmjvOUsZzS8N5WXkaSwEcHDShL0JuGA9WGrKPh3T0EscM062LgFnYuNIDvv7rNGcCDR50gOZ6dfbE0YIKbXcl965O+LfLV2TvgaB8gMTA==',key_name='tempest-keypair-1994588440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-jc3ugci0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=476294df-90d7-4caa-810c-e129fac28897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'pci_devices' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:10:46 user nova-compute[71026]:   <uuid>476294df-90d7-4caa-810c-e129fac28897</uuid>
Jul 27 17:10:46 user nova-compute[71026]:   <name>instance-0000002e</name>
Jul 27 17:10:46 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:10:46 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:10:46 user nova-compute[71026]:   <metadata>
Jul 27 17:10:46 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:10:46 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1518504960</nova:name>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:10:46</nova:creationTime>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:10:46 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:10:46 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:owner>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:user uuid="32fb8f31ad924af19499c72671d0cfd4">tempest-AttachVolumeNegativeTest-881744709-project-member</nova:user>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:project uuid="755fc60deefd4468a017742d1a5f922e">tempest-AttachVolumeNegativeTest-881744709</nova:project>
Jul 27 17:10:46 user nova-compute[71026]:       </nova:owner>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:10:46 user nova-compute[71026]:       <nova:ports>
Jul 27 17:10:46 user nova-compute[71026]:         <nova:port uuid="fcf3840c-4db8-454e-b31b-9feaf6750cda">
Jul 27 17:10:46 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 27 17:10:46 user nova-compute[71026]:         </nova:port>
Jul 27 17:10:46 user nova-compute[71026]:       </nova:ports>
Jul 27 17:10:46 user nova-compute[71026]:     </nova:instance>
Jul 27 17:10:46 user nova-compute[71026]:   </metadata>
Jul 27 17:10:46 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:10:46 user nova-compute[71026]:     <system>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="serial">476294df-90d7-4caa-810c-e129fac28897</entry>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="uuid">476294df-90d7-4caa-810c-e129fac28897</entry>
Jul 27 17:10:46 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:10:46 user nova-compute[71026]:     </system>
Jul 27 17:10:46 user nova-compute[71026]:   </sysinfo>
Jul 27 17:10:46 user nova-compute[71026]:   <os>
Jul 27 17:10:46 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:10:46 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:10:46 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:10:46 user nova-compute[71026]:   </os>
Jul 27 17:10:46 user nova-compute[71026]:   <features>
Jul 27 17:10:46 user nova-compute[71026]:     <acpi/>
Jul 27 17:10:46 user nova-compute[71026]:     <apic/>
Jul 27 17:10:46 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:10:46 user nova-compute[71026]:   </features>
Jul 27 17:10:46 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:10:46 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:10:46 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:10:46 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:10:46 user nova-compute[71026]:   </clock>
Jul 27 17:10:46 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:10:46 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:10:46 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:10:46 user nova-compute[71026]:   </cpu>
Jul 27 17:10:46 user nova-compute[71026]:   <devices>
Jul 27 17:10:46 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:10:46 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:10:46 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk"/>
Jul 27 17:10:46 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:10:46 user nova-compute[71026]:     </disk>
Jul 27 17:10:46 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:10:46 user nova-compute[71026]:       <mac address="fa:16:3e:5b:6a:3b"/>
Jul 27 17:10:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:10:46 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:10:46 user nova-compute[71026]:       <target dev="tapfcf3840c-4d"/>
Jul 27 17:10:46 user nova-compute[71026]:     </interface>
Jul 27 17:10:46 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:10:46 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/console.log" append="off"/>
Jul 27 17:10:46 user nova-compute[71026]:     </serial>
Jul 27 17:10:46 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:10:46 user nova-compute[71026]:     <video>
Jul 27 17:10:46 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:10:46 user nova-compute[71026]:     </video>
Jul 27 17:10:46 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:10:46 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:10:46 user nova-compute[71026]:     </rng>
Jul 27 17:10:46 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:10:46 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:10:46 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:10:46 user nova-compute[71026]:     </memballoon>
Jul 27 17:10:46 user nova-compute[71026]:   </devices>
Jul 27 17:10:46 user nova-compute[71026]: </domain>
Jul 27 17:10:46 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518504960',display_name='tempest-AttachVolumeNegativeTest-server-1518504960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1518504960',id=46,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbvoHxjoYHTFqJ9ySlGs9RiCXmjvOUsZzS8N5WXkaSwEcHDShL0JuGA9WGrKPh3T0EscM062LgFnYuNIDvv7rNGcCDR50gOZ6dfbE0YIKbXcl965O+LfLV2TvgaB8gMTA==',key_name='tempest-keypair-1994588440',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-jc3ugci0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=476294df-90d7-4caa-810c-e129fac28897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG os_vif [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf3840c-4d, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcf3840c-4d, col_values=(('external_ids', {'iface-id': 'fcf3840c-4db8-454e-b31b-9feaf6750cda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:6a:3b', 'vm-uuid': '476294df-90d7-4caa-810c-e129fac28897'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:46 user nova-compute[71026]: INFO os_vif [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d')
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:5b:6a:3b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updated VIF entry in instance network info cache for port fcf3840c-4db8-454e-b31b-9feaf6750cda. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG nova.network.neutron [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f703ed5b-629b-4a71-aebd-77b866f4ed0e req-4c930f08-5cfe-4692-a4a5-ef4dab20ce26 service nova] Releasing lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Skipping network cache update for instance because it is Building. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:47 user nova-compute[71026]: INFO nova.compute.manager [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Detaching volume c75a23f9-ee84-408c-8cc1-de6edfa557e9
Jul 27 17:10:47 user nova-compute[71026]: INFO nova.virt.block_device [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Attempting to driver detach volume c75a23f9-ee84-408c-8cc1-de6edfa557e9 from mountpoint /dev/vdb
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Attempting to detach device vdb from instance bb04bc7c-ab87-467d-816a-2753b42944af from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:10:47 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:10:47 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:10:47 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:10:47 user nova-compute[71026]:   <serial>c75a23f9-ee84-408c-8cc1-de6edfa557e9</serial>
Jul 27 17:10:47 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:10:47 user nova-compute[71026]: </disk>
Jul 27 17:10:47 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:47 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully detached device vdb from instance bb04bc7c-ab87-467d-816a-2753b42944af from the persistent domain config.
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb04bc7c-ab87-467d-816a-2753b42944af from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:10:47 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:10:47 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:10:47 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:10:47 user nova-compute[71026]:   <serial>c75a23f9-ee84-408c-8cc1-de6edfa557e9</serial>
Jul 27 17:10:47 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:10:47 user nova-compute[71026]: </disk>
Jul 27 17:10:47 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [{"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-bb04bc7c-ab87-467d-816a-2753b42944af" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690477848.0850484, bb04bc7c-ab87-467d-816a-2753b42944af => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:10:48 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully detached device vdb from instance bb04bc7c-ab87-467d-816a-2753b42944af from the live domain config.
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.compute.manager [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] No waiting events found dispatching network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:10:48 user nova-compute[71026]: WARNING nova.compute.manager [req-757e81a7-6134-4470-94e7-c77db5760315 req-37a4e3da-bc49-4469-ae77-d4f8eb60ef02 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received unexpected event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda for instance with vm_state building and task_state spawning.
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbFBOroJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:10:48 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd7dc4-88f2-4a26-8d12-93958b08f90f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:10:48 user nova-compute[71026]: No targets found.
Jul 27 17:10:48 user nova-compute[71026]: iSNS:
Jul 27 17:10:48 user nova-compute[71026]: No targets found.
Jul 27 17:10:48 user nova-compute[71026]: STATIC:
Jul 27 17:10:48 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9
Jul 27 17:10:48 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:10:48 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:10:48 user nova-compute[71026]: FIRMWARE:
Jul 27 17:10:48 user nova-compute[71026]: No targets found.
Jul 27 17:10:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:10:48 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:10:48 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2bedf2-561b-40ce-a004-bea205f451b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52128b82-28f4-41ee-aaf2-c348618ca108]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)
Jul 27 17:10:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 (non-flash)
Jul 27 17:10:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30881d49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7abc1c-3c60-4707-af4e-f3ce9198ee1f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d240d5ee-f639-40ad-b5a0-f34b8415cd41]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d824fdd-f9d4-4e47-9db9-614ddde6e652]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9a0ad-e21b-44bb-9da9-034392a0aff9]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[95552ec0-b082-47a9-b0cd-58609b4d9d1c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b08f0b-2a0a-4771-b05d-28edefa178dd]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260]
Jul 27 17:10:48 user nova-compute[71026]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9, portal: 172.16.0.220,3260] successful.
Jul 27 17:10:48 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffaf99e-1431-44d1-928a-c372e9db6bb8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== disconnect_volume: return (325ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG nova.objects.instance [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'flavor' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-7af1cf20-cb73-4fd3-812e-f6f361445f44 tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.740s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.620s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:49 user nova-compute[71026]: INFO nova.compute.manager [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Terminating instance
Jul 27 17:10:49 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Instance destroyed successfully.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lazy-loading 'resources' on Instance uuid bb04bc7c-ab87-467d-816a-2753b42944af {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:08:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-19456454',display_name='tempest-VolumesSnapshotTestJSON-instance-19456454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-19456454',id=45,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPuUXxlPoqELM6ccYZX+OBLyOOzy8yGXIRbyoYpfpd9XlY3iQIeY4yKJFGayWz5JrcPDmeXMgFplZedDFPfNkzSGJE+PUj09Ytl+Wm76MIcxzzNUS3TG7v8nq6ov/QZdA==',key_name='tempest-keypair-2087577319',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:08:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd9953dd1d0240c8876b8235e47740de',ramdisk_id='',reservation_id='r-pynpiz60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-270009591',owner_user_name='tempest-VolumesSnapshotTestJSON-270009591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:08:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27622507ef1240d9adf5d005035e2bc9',uuid=bb04bc7c-ab87-467d-816a-2753b42944af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converting VIF {"id": "4f782c40-4fca-4882-900d-43e63f15cd9a", "address": "fa:16:3e:e0:04:38", "network": {"id": "fd5da76b-0a5a-4fb5-835f-67bd651f5d86", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-207505519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd9953dd1d0240c8876b8235e47740de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f782c40-4f", "ovs_interfaceid": "4f782c40-4fca-4882-900d-43e63f15cd9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_vif [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f782c40-4f, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:10:50 user nova-compute[71026]: INFO os_vif [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:04:38,bridge_name='br-int',has_traffic_filtering=True,id=4f782c40-4fca-4882-900d-43e63f15cd9a,network=Network(fd5da76b-0a5a-4fb5-835f-67bd651f5d86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f782c40-4f')
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:c75a23f9-ee84-408c-8cc1-de6edfa557e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbFBOroJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:10:50 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[06f64338-3557-4bf3-b4d3-e065138af989]: Unexpected error while running command.
Jul 27 17:10:50 user nova-compute[71026]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 17:10:50 user nova-compute[71026]: Exit code: 21
Jul 27 17:10:50 user nova-compute[71026]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 17:10:50 user nova-compute[71026]: Stderr: '' {{(pid=82023) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Jul 27 17:10:50 user nova-compute[71026]: Traceback (most recent call last):
Jul 27 17:10:50 user nova-compute[71026]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jul 27 17:10:50 user nova-compute[71026]:     ret = func(*f_args, **f_kwargs)
Jul 27 17:10:50 user nova-compute[71026]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jul 27 17:10:50 user nova-compute[71026]:     return func(*args, **kwargs)
Jul 27 17:10:50 user nova-compute[71026]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jul 27 17:10:50 user nova-compute[71026]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jul 27 17:10:50 user nova-compute[71026]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jul 27 17:10:50 user nova-compute[71026]:     return putils.execute(on_execute=on_execute,
Jul 27 17:10:50 user nova-compute[71026]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Jul 27 17:10:50 user nova-compute[71026]:     raise ProcessExecutionError(exit_code=_returncode,
Jul 27 17:10:50 user nova-compute[71026]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 17:10:50 user nova-compute[71026]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 17:10:50 user nova-compute[71026]: Exit code: 21
Jul 27 17:10:50 user nova-compute[71026]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 17:10:50 user nova-compute[71026]: Stderr: ''
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f64338-3557-4bf3-b4d3-e065138af989]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 17:10:50 user nova-compute[71026]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 17:10:50 user nova-compute[71026]: Exit code: 21
Jul 27 17:10:50 user nova-compute[71026]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 17:10:50 user nova-compute[71026]: Stderr: ''
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Jul 27 17:10:50 user nova-compute[71026]: ERROR os_brick.initiator.connectors.iscsi 
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71026) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] <== disconnect_volume: return (36ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Deleting instance files /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af_del
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Deletion of /opt/stack/data/nova/instances/bb04bc7c-ab87-467d-816a-2753b42944af_del complete
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] No waiting events found dispatching network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:10:50 user nova-compute[71026]: WARNING nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received unexpected event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda for instance with vm_state building and task_state spawning.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-unplugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] No waiting events found dispatching network-vif-unplugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-unplugged-4f782c40-4fca-4882-900d-43e63f15cd9a for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Acquiring lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] Lock "bb04bc7c-ab87-467d-816a-2753b42944af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] No waiting events found dispatching network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:10:50 user nova-compute[71026]: WARNING nova.compute.manager [req-c98fde2c-f53c-47e9-82d6-d8bf46b2ae3b req-85dc7dfa-6b0b-4657-8b81-26764a2336f4 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received unexpected event network-vif-plugged-4f782c40-4fca-4882-900d-43e63f15cd9a for instance with vm_state active and task_state deleting.
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477850.2803361, 476294df-90d7-4caa-810c-e129fac28897 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] VM Resumed (Lifecycle Event)
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] Instance spawned successfully.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477850.2840843, 476294df-90d7-4caa-810c-e129fac28897 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] VM Started (Lifecycle Event)
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Took 7.07 seconds to spawn the instance on the hypervisor.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:10:50 user nova-compute[71026]: INFO nova.compute.manager [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Took 7.67 seconds to build instance.
Jul 27 17:10:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-722b9d2d-78e3-4065-a3f8-9f566eae9dbc tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.759s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:51 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Took 0.92 seconds to deallocate network for instance.
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-d463cd63-291e-4a4f-a451-ff37b1848da5 req-0e04a700-cf47-4d42-b209-d4d37793e3a7 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Received event network-vif-deleted-4f782c40-4fca-4882-900d-43e63f15cd9a {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:10:51 user nova-compute[71026]: INFO nova.compute.manager [req-d463cd63-291e-4a4f-a451-ff37b1848da5 req-0e04a700-cf47-4d42-b209-d4d37793e3a7 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Neutron deleted interface 4f782c40-4fca-4882-900d-43e63f15cd9a; detaching it from the instance and deleting it from the info cache
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.network.neutron [req-d463cd63-291e-4a4f-a451-ff37b1848da5 req-0e04a700-cf47-4d42-b209-d4d37793e3a7 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:10:51 user nova-compute[71026]: WARNING nova.volume.cinder [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Attachment 520a9131-07b1-452a-81af-6377d552feeb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 520a9131-07b1-452a-81af-6377d552feeb. (HTTP 404) (Request-ID: req-054c4f74-466e-4fca-a393-a3e805572f99)
Jul 27 17:10:51 user nova-compute[71026]: INFO nova.compute.manager [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Took 0.03 seconds to detach 1 volumes for instance.
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.compute.manager [req-d463cd63-291e-4a4f-a451-ff37b1848da5 req-0e04a700-cf47-4d42-b209-d4d37793e3a7 service nova] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Detach interface failed, port_id=4f782c40-4fca-4882-900d-43e63f15cd9a, reason: Instance bb04bc7c-ab87-467d-816a-2753b42944af could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:10:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:51 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Deleted allocations for instance bb04bc7c-ab87-467d-816a-2753b42944af
Jul 27 17:10:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1e69d12f-542a-4d96-9f38-4f455c78bfbd tempest-VolumesSnapshotTestJSON-270009591 tempest-VolumesSnapshotTestJSON-270009591-project-member] Lock "bb04bc7c-ab87-467d-816a-2753b42944af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:10:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:10:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:10:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:04 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:11:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:05 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690477850.0108986, bb04bc7c-ab87-467d-816a-2753b42944af => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:11:05 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] VM Stopped (Lifecycle Event)
Jul 27 17:11:05 user nova-compute[71026]: DEBUG nova.compute.manager [None req-1b5ae7a8-2f39-4bd1-8c4e-2e4b5ed071b3 None None] [instance: bb04bc7c-ab87-467d-816a-2753b42944af] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:11:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:11:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:11:19 user nova-compute[71026]: INFO nova.compute.claims [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Claim successful on node user
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:11:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.policy [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '820e443fd72d4e2c90a31c8b63ef495c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789c6f3e53b643728abe414f52d33edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:11:19 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Creating image(s)
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "fccb086cc3173a9f7bf8546549de637f08a180a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "fccb086cc3173a9f7bf8546549de637f08a180a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.part --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG nova.virt.images [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] d9063e01-3f2b-4644-a956-104d09e1d66c was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.part /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Successfully created port: 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.part /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.converted" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "fccb086cc3173a9f7bf8546549de637f08a180a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.854s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "fccb086cc3173a9f7bf8546549de637f08a180a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "fccb086cc3173a9f7bf8546549de637f08a180a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2,backing_fmt=raw /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2,backing_fmt=raw /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk 1073741824" returned: 0 in 0.048s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "fccb086cc3173a9f7bf8546549de637f08a180a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:11:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Successfully updated port: 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing instance network info cache due to event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Cannot resize image /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'migration_context' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Ensure instance console log exists: /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-c1c0c122-3296-4c3d-9925-67b8f28f2952 req-6db12496-2f84-47be-875b-647fd2142b81 service nova] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance network_info: |[{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start _get_guest_xml network_info=[{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:11:16Z,direct_url=<?>,disk_format='qcow2',id=d9063e01-3f2b-4644-a956-104d09e1d66c,min_disk=0,min_ram=0,name='tempest-scenario-img--1054609034',owner='789c6f3e53b643728abe414f52d33edc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:11:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'd9063e01-3f2b-4644-a956-104d09e1d66c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:11:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:11:21 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:11:16Z,direct_url=<?>,disk_format='qcow2',id=d9063e01-3f2b-4644-a956-104d09e1d66c,min_disk=0,min_ram=0,name='tempest-scenario-img--1054609034',owner='789c6f3e53b643728abe414f52d33edc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:11:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:11:20Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'pci_devices' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:11:21 user nova-compute[71026]:   <uuid>990bca8b-8771-4948-9b3b-3aa6a0c5e39a</uuid>
Jul 27 17:11:21 user nova-compute[71026]:   <name>instance-0000002f</name>
Jul 27 17:11:21 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:11:21 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:11:21 user nova-compute[71026]:   <metadata>
Jul 27 17:11:21 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:11:21 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:name>tempest-TestMinimumBasicScenario-server-1595506423</nova:name>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:11:21</nova:creationTime>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:11:21 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:11:21 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:owner>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:user uuid="820e443fd72d4e2c90a31c8b63ef495c">tempest-TestMinimumBasicScenario-860753275-project-member</nova:user>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:project uuid="789c6f3e53b643728abe414f52d33edc">tempest-TestMinimumBasicScenario-860753275</nova:project>
Jul 27 17:11:21 user nova-compute[71026]:       </nova:owner>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:root type="image" uuid="d9063e01-3f2b-4644-a956-104d09e1d66c"/>
Jul 27 17:11:21 user nova-compute[71026]:       <nova:ports>
Jul 27 17:11:21 user nova-compute[71026]:         <nova:port uuid="43f6d63e-11f8-4a17-968f-774ae5edefa8">
Jul 27 17:11:21 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:11:21 user nova-compute[71026]:         </nova:port>
Jul 27 17:11:21 user nova-compute[71026]:       </nova:ports>
Jul 27 17:11:21 user nova-compute[71026]:     </nova:instance>
Jul 27 17:11:21 user nova-compute[71026]:   </metadata>
Jul 27 17:11:21 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:11:21 user nova-compute[71026]:     <system>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="serial">990bca8b-8771-4948-9b3b-3aa6a0c5e39a</entry>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="uuid">990bca8b-8771-4948-9b3b-3aa6a0c5e39a</entry>
Jul 27 17:11:21 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:11:21 user nova-compute[71026]:     </system>
Jul 27 17:11:21 user nova-compute[71026]:   </sysinfo>
Jul 27 17:11:21 user nova-compute[71026]:   <os>
Jul 27 17:11:21 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:11:21 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:11:21 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:11:21 user nova-compute[71026]:   </os>
Jul 27 17:11:21 user nova-compute[71026]:   <features>
Jul 27 17:11:21 user nova-compute[71026]:     <acpi/>
Jul 27 17:11:21 user nova-compute[71026]:     <apic/>
Jul 27 17:11:21 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:11:21 user nova-compute[71026]:   </features>
Jul 27 17:11:21 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:11:21 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:11:21 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:11:21 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:11:21 user nova-compute[71026]:   </clock>
Jul 27 17:11:21 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:11:21 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:11:21 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:11:21 user nova-compute[71026]:   </cpu>
Jul 27 17:11:21 user nova-compute[71026]:   <devices>
Jul 27 17:11:21 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:11:21 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:11:21 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk"/>
Jul 27 17:11:21 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:11:21 user nova-compute[71026]:     </disk>
Jul 27 17:11:21 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:11:21 user nova-compute[71026]:       <mac address="fa:16:3e:f1:44:62"/>
Jul 27 17:11:21 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:11:21 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:11:21 user nova-compute[71026]:       <target dev="tap43f6d63e-11"/>
Jul 27 17:11:21 user nova-compute[71026]:     </interface>
Jul 27 17:11:21 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:11:21 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/console.log" append="off"/>
Jul 27 17:11:21 user nova-compute[71026]:     </serial>
Jul 27 17:11:21 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:11:21 user nova-compute[71026]:     <video>
Jul 27 17:11:21 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:11:21 user nova-compute[71026]:     </video>
Jul 27 17:11:21 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:11:21 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:11:21 user nova-compute[71026]:     </rng>
Jul 27 17:11:21 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:11:21 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:11:21 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:11:21 user nova-compute[71026]:     </memballoon>
Jul 27 17:11:21 user nova-compute[71026]:   </devices>
Jul 27 17:11:21 user nova-compute[71026]: </domain>
Jul 27 17:11:21 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:11:20Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG os_vif [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43f6d63e-11, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43f6d63e-11, col_values=(('external_ids', {'iface-id': '43f6d63e-11f8-4a17-968f-774ae5edefa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:44:62', 'vm-uuid': '990bca8b-8771-4948-9b3b-3aa6a0c5e39a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:21 user nova-compute[71026]: INFO os_vif [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11')
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:11:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No VIF found with MAC fa:16:3e:f1:44:62, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:11:23 user nova-compute[71026]: WARNING nova.compute.manager [req-cf49eb26-29f5-42d9-830f-22fb0ff49a6c req-45e476a0-8806-4120-a266-3a77c2018986 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state building and task_state spawning.
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477885.1593716, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] VM Resumed (Lifecycle Event)
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance spawned successfully.
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477885.1624925, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] VM Started (Lifecycle Event)
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Took 5.62 seconds to spawn the instance on the hypervisor.
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:11:25 user nova-compute[71026]: INFO nova.compute.manager [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Took 6.13 seconds to build instance.
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:11:25 user nova-compute[71026]: WARNING nova.compute.manager [req-a3ea48b6-f40c-4642-8c11-bd4681d54515 req-ffda775c-4cd6-4571-a1f4-5e3bd80101a1 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state None.
Jul 27 17:11:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-36b2860d-46cd-4353-afb4-e9e42ec1efc3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.250s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:46 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:11:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:11:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:11:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=25.331409454345703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:11:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:11:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:11:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:11:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:12:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:12:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-changed-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:12:33 user nova-compute[71026]: DEBUG nova.compute.manager [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Refreshing instance network info cache due to event network-changed-fcf3840c-4db8-454e-b31b-9feaf6750cda. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:12:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] Acquiring lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:12:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] Acquired lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:12:33 user nova-compute[71026]: DEBUG nova.network.neutron [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Refreshing network info cache for port fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:12:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updated VIF entry in instance network info cache for port fcf3840c-4db8-454e-b31b-9feaf6750cda. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:12:34 user nova-compute[71026]: DEBUG nova.network.neutron [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:12:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f122a32d-5d26-4e5f-83d0-c785a70037d2 req-95726e9c-ee9f-41e7-9471-ed967e77a9a1 service nova] Releasing lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:12:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG nova.objects.instance [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:37 user nova-compute[71026]: INFO nova.compute.manager [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Attaching volume 28335e0d-c430-461d-a821-05b3c9855030 to /dev/vdb
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dce743-d79e-4a38-9879-8b52789b4cc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f1a7ce-042e-494f-b148-73b48d74ba84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[868114ad-df67-4d13-9cee-320c478057d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4213be5-1745-452a-b646-17d27068ab69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:12:38 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:12:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab974db1-6230-4653-b286-f9e1f97a24fb]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG os_brick.utils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:12:38 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating existing volume attachment record: 34e86301-e2b0-4917-80f5-be2433281fe1 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:12:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:43 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCpqgjZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:12:44 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:12:44 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:12:44 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0362d7-4042-41ca-8c74-fa6a82f831cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:12:44 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce45b6b-f357-47b4-a48f-7d64ac19b2cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030] added
Jul 27 17:12:44 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa75fad-c6b8-4557-85c3-4cf01aa7daf6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e968f8-348b-4bb5-b821-458df6716dd6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCpqgjZH {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCpqgjZH" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b595a2f0-dfae-4fe4-a480-e060a519aa48]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCpqgjZH'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7518658-6c26-44cc-8981-8364e4b72374]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef40465-bfdc-4e44-bb16-a7af10703812]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:12:44 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:12:44 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:12:44 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 17:12:44 user nova-compute[71026]: 
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6127d747-49ac-4bc1-ab4d-d57b8cefac6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260]
Jul 27 17:12:44 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260] successful.
Jul 27 17:12:44 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:44 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c39a0f-39ea-4d5a-9755-10e7051d577f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff626f1-5687-4309-ab48-d2ea91f531f9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:12:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:12:45 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb37f72c-c96a-412f-ad4a-6df1b7134153]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:12:45 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCpqgjZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23963376236303564', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963376236303564', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.objects.instance [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:12:46 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:12:46 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:12:46 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:12:46 user nova-compute[71026]:   <serial>28335e0d-c430-461d-a821-05b3c9855030</serial>
Jul 27 17:12:46 user nova-compute[71026]: </disk>
Jul 27 17:12:46 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:5b:6a:3b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-18c3475a-9665-4b4c-acf1-dff2313ba4d9 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.727s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:12:47 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:12:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:12:48 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=25.327899932861328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:12:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:12:50 user nova-compute[71026]: INFO nova.compute.claims [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Claim successful on node user
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:12:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.policy [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32fb8f31ad924af19499c72671d0cfd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755fc60deefd4468a017742d1a5f922e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:12:50 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Creating image(s)
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk 1073741824" returned: 0 in 0.049s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Successfully created port: bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Cannot resize image /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'migration_context' on Instance uuid 4b351682-2e9b-4010-8782-19b9ff51fa37 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Ensure instance console log exists: /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Successfully updated port: bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquired lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-changed-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.compute.manager [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Refreshing instance network info cache due to event network-changed-bd4e3e56-193a-46d0-ac82-390c6179ddd2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] Acquiring lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updating instance_info_cache with network_info: [{"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Releasing lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Instance network_info: |[{"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] Acquired lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.network.neutron [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Refreshing network info cache for port bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Start _get_guest_xml network_info=[{"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:12:52 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:12:52 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:12:52 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1767407769',display_name='tempest-AttachVolumeNegativeTest-server-1767407769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1767407769',id=48,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2MRgf7pdXB1qma0L97Z3Ol7mInNJe/Ghqbs1FgQH2wq07je+tCpVmqRYvdsvXzj6xB817BqieJb/5xSDXI4tDctp5RA5ig8GxVQV4hCld4ha2BqZvL1Tkv2KucCc2Ebw==',key_name='tempest-keypair-1679475229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-4udp3ohv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=4b351682-2e9b-4010-8782-19b9ff51fa37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.objects.instance [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b351682-2e9b-4010-8782-19b9ff51fa37 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:12:53 user nova-compute[71026]:   <uuid>4b351682-2e9b-4010-8782-19b9ff51fa37</uuid>
Jul 27 17:12:53 user nova-compute[71026]:   <name>instance-00000030</name>
Jul 27 17:12:53 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:12:53 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:12:53 user nova-compute[71026]:   <metadata>
Jul 27 17:12:53 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:12:53 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1767407769</nova:name>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:12:52</nova:creationTime>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:12:53 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:12:53 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:owner>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:user uuid="32fb8f31ad924af19499c72671d0cfd4">tempest-AttachVolumeNegativeTest-881744709-project-member</nova:user>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:project uuid="755fc60deefd4468a017742d1a5f922e">tempest-AttachVolumeNegativeTest-881744709</nova:project>
Jul 27 17:12:53 user nova-compute[71026]:       </nova:owner>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:12:53 user nova-compute[71026]:       <nova:ports>
Jul 27 17:12:53 user nova-compute[71026]:         <nova:port uuid="bd4e3e56-193a-46d0-ac82-390c6179ddd2">
Jul 27 17:12:53 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 27 17:12:53 user nova-compute[71026]:         </nova:port>
Jul 27 17:12:53 user nova-compute[71026]:       </nova:ports>
Jul 27 17:12:53 user nova-compute[71026]:     </nova:instance>
Jul 27 17:12:53 user nova-compute[71026]:   </metadata>
Jul 27 17:12:53 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:12:53 user nova-compute[71026]:     <system>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="serial">4b351682-2e9b-4010-8782-19b9ff51fa37</entry>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="uuid">4b351682-2e9b-4010-8782-19b9ff51fa37</entry>
Jul 27 17:12:53 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:12:53 user nova-compute[71026]:     </system>
Jul 27 17:12:53 user nova-compute[71026]:   </sysinfo>
Jul 27 17:12:53 user nova-compute[71026]:   <os>
Jul 27 17:12:53 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:12:53 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:12:53 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:12:53 user nova-compute[71026]:   </os>
Jul 27 17:12:53 user nova-compute[71026]:   <features>
Jul 27 17:12:53 user nova-compute[71026]:     <acpi/>
Jul 27 17:12:53 user nova-compute[71026]:     <apic/>
Jul 27 17:12:53 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:12:53 user nova-compute[71026]:   </features>
Jul 27 17:12:53 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:12:53 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:12:53 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:12:53 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:12:53 user nova-compute[71026]:   </clock>
Jul 27 17:12:53 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:12:53 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:12:53 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:12:53 user nova-compute[71026]:   </cpu>
Jul 27 17:12:53 user nova-compute[71026]:   <devices>
Jul 27 17:12:53 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:12:53 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:12:53 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk"/>
Jul 27 17:12:53 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:12:53 user nova-compute[71026]:     </disk>
Jul 27 17:12:53 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:12:53 user nova-compute[71026]:       <mac address="fa:16:3e:89:c7:18"/>
Jul 27 17:12:53 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:12:53 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:12:53 user nova-compute[71026]:       <target dev="tapbd4e3e56-19"/>
Jul 27 17:12:53 user nova-compute[71026]:     </interface>
Jul 27 17:12:53 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:12:53 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/console.log" append="off"/>
Jul 27 17:12:53 user nova-compute[71026]:     </serial>
Jul 27 17:12:53 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:12:53 user nova-compute[71026]:     <video>
Jul 27 17:12:53 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:12:53 user nova-compute[71026]:     </video>
Jul 27 17:12:53 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:12:53 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:12:53 user nova-compute[71026]:     </rng>
Jul 27 17:12:53 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:12:53 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:12:53 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:12:53 user nova-compute[71026]:     </memballoon>
Jul 27 17:12:53 user nova-compute[71026]:   </devices>
Jul 27 17:12:53 user nova-compute[71026]: </domain>
Jul 27 17:12:53 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1767407769',display_name='tempest-AttachVolumeNegativeTest-server-1767407769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1767407769',id=48,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2MRgf7pdXB1qma0L97Z3Ol7mInNJe/Ghqbs1FgQH2wq07je+tCpVmqRYvdsvXzj6xB817BqieJb/5xSDXI4tDctp5RA5ig8GxVQV4hCld4ha2BqZvL1Tkv2KucCc2Ebw==',key_name='tempest-keypair-1679475229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-4udp3ohv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:12:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=4b351682-2e9b-4010-8782-19b9ff51fa37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG os_vif [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd4e3e56-19, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd4e3e56-19, col_values=(('external_ids', {'iface-id': 'bd4e3e56-193a-46d0-ac82-390c6179ddd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:c7:18', 'vm-uuid': '4b351682-2e9b-4010-8782-19b9ff51fa37'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:53 user nova-compute[71026]: INFO os_vif [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19')
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:89:c7:18, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updated VIF entry in instance network info cache for port bd4e3e56-193a-46d0-ac82-390c6179ddd2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG nova.network.neutron [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updating instance_info_cache with network_info: [{"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:12:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ea387b7a-83bc-48a1-8b49-b19d9ce2dd93 req-0d7b9dec-ea3f-442a-a938-d2f6f3140420 service nova] Releasing lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:54 user nova-compute[71026]: DEBUG nova.compute.manager [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] No waiting events found dispatching network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:12:54 user nova-compute[71026]: WARNING nova.compute.manager [req-51069ea6-e6a4-4a6d-a04d-ab4289ddeb9a req-7cf58fae-dc6b-4a48-90db-32a864e0d845 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received unexpected event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 for instance with vm_state building and task_state spawning.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477976.5325143, 4b351682-2e9b-4010-8782-19b9ff51fa37 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] VM Resumed (Lifecycle Event)
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Instance spawned successfully.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690477976.537024, 4b351682-2e9b-4010-8782-19b9ff51fa37 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] VM Started (Lifecycle Event)
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Took 5.65 seconds to spawn the instance on the hypervisor.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:56 user nova-compute[71026]: DEBUG nova.compute.manager [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] No waiting events found dispatching network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:12:56 user nova-compute[71026]: WARNING nova.compute.manager [req-1f9f2a47-a451-46a7-9775-45237e78c9ac req-6ea332cb-f5cf-4279-ba52-da6f69631be2 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received unexpected event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 for instance with vm_state building and task_state spawning.
Jul 27 17:12:56 user nova-compute[71026]: INFO nova.compute.manager [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Took 6.21 seconds to build instance.
Jul 27 17:12:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-4d615667-169a-48fc-b8c9-f4ff1ed21896 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.310s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:12:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:12:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:12:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:12 user nova-compute[71026]: INFO nova.compute.manager [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Attaching volume 6e5a4ab6-474c-4aba-9aa0-06484034fb74 to /dev/vdb
Jul 27 17:13:12 user nova-compute[71026]: DEBUG os_brick.utils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bdd8e8-a1fb-45e1-b92d-6d584c3f2b1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12bf6fd-67e5-45f3-adc6-783c41c6d4b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fee8bcd-eefd-4071-8d42-5c947b1d5434]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad08e331-a3a4-4f38-a156-7f76e6448369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:13:13 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:13:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53e3033-df47-42a8-a32e-80c545412447]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG os_brick.utils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:13:13 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating existing volume attachment record: 48ad8834-721f-4a8e-a8a9-7ccf159468d7 {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:13:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:13:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:13:19 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:13:19 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb12f6bd-b933-4846-b428-0faeb22fe383]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:13:19 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b7f64-5bd4-4c77-9376-76d0ba888a04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74] added
Jul 27 17:13:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b564e5e4-a198-4678-b6ec-e37a1096b929]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde02da0-030c-48ec-8a87-2ba000af4bfd]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbycSxIK {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbycSxIK" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b85673-ff96-4a6f-b965-e1f37a5a95a7]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbycSxIK'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c400eb9-0d20-403f-8a0c-c5c707bade46]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ae1dc-641e-4385-9861-f7190b589f23]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:19 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:13:19 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7e927-f233-4c5b-9c7d-bc98d3329303]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]
Jul 27 17:13:20 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.
Jul 27 17:13:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10add23f-5a18-4a0c-831d-b02ccf360d25]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71d76c-0331-4971-86a7-e1bbd679d2a0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:20 user nova-compute[71026]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:20 user nova-compute[71026]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd02c61-6d13-4cc0-a64d-49f6f0ab0166]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26566393631343634', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566393631343634', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:13:21 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:13:21 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:13:21 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:13:21 user nova-compute[71026]:   <serial>6e5a4ab6-474c-4aba-9aa0-06484034fb74</serial>
Jul 27 17:13:21 user nova-compute[71026]: </disk>
Jul 27 17:13:21 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No VIF found with MAC fa:16:3e:f1:44:62, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:13:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f5cc25fd-617b-45b8-8f1f-b59d126dad05 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.768s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:29 user nova-compute[71026]: DEBUG nova.compute.manager [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing instance network info cache due to event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:13:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:13:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:13:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:13:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated VIF entry in instance network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:13:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:13:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-04cdfeda-2538-4371-bcb1-2fcd956b6ab1 req-373f2f9e-a62b-482f-a8a9-3a5c23cd6b2c service nova] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:13:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:31 user nova-compute[71026]: DEBUG nova.compute.manager [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing instance network info cache due to event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:13:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:13:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:13:31 user nova-compute[71026]: DEBUG nova.network.neutron [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:13:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated VIF entry in instance network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:13:32 user nova-compute[71026]: DEBUG nova.network.neutron [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:13:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f6965423-4cb6-4935-8a84-88d7e3b6dec8 req-1c6d4d15-1754-4aca-b0f6-9557a7a555b7 service nova] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:13:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:13:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:36 user nova-compute[71026]: INFO nova.compute.manager [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Rebooting instance
Jul 27 17:13:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:13:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:13:36 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG nova.network.neutron [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG nova.compute.manager [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:37 user nova-compute[71026]: WARNING nova.compute.manager [req-5b146117-e44f-4c91-931e-cfbfc752fdd4 req-46ce4c8f-09f3-4e4f-9e85-6fc72868abcf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance destroyed successfully.
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'resources' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:13:37Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43f6d63e-11, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:13:38 user nova-compute[71026]: INFO os_vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11')
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:13:38 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e755e1-0a4e-45af-aa9d-5d2dd3d6d54d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:13:38 user nova-compute[71026]: No targets found.
Jul 27 17:13:38 user nova-compute[71026]: iSNS:
Jul 27 17:13:38 user nova-compute[71026]: No targets found.
Jul 27 17:13:38 user nova-compute[71026]: STATIC:
Jul 27 17:13:38 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74
Jul 27 17:13:38 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:13:38 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:13:38 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030
Jul 27 17:13:38 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:13:38 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:13:38 user nova-compute[71026]: FIRMWARE:
Jul 27 17:13:38 user nova-compute[71026]: No targets found.
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:13:38 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:13:38 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f4c66-a9af-4b35-b57e-3f31d5cc6d11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5440a0d4-8c4d-46d9-8f00-b558d4ac3231]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a80b23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dd19a7-34b0-4513-b512-01a19d37effb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[43351fb6-2b37-42e2-af83-808d06eb9021]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[844c4fb7-a054-45a3-bcfb-99c82a640701]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b8b0cb-d2bf-4b29-9087-94db77e71606]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50e231-ae41-4ed9-bc92-4bfd1b3ccafb]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2f4ae0-9f7e-4477-bf27-f75e5c2d4012]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]
Jul 27 17:13:38 user nova-compute[71026]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c9114-0fb3-4e81-994a-bdd1043debf4]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== disconnect_volume: return (325ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start _get_guest_xml network_info=[{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9063e01-3f2b-4644-a956-104d09e1d66c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': 'd9063e01-3f2b-4644-a956-104d09e1d66c'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '48ad8834-721f-4a8e-a8a9-7ccf159468d7', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '990bca8b-8771-4948-9b3b-3aa6a0c5e39a', 'attached_at': '', 'detached_at': '', 'volume_id': '6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'serial': '6e5a4ab6-474c-4aba-9aa0-06484034fb74'}, 'device_type': 'disk', 'volume_type': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:13:38 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:13:38 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9063e01-3f2b-4644-a956-104d09e1d66c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'vcpu_model' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:13:38 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:13:38 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:13:38 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9640ea74-c213-4f36-8f23-db8a59e5e994]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:13:38 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce30f351-5667-45fd-99dd-3f974e4dfb10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74] added
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc00682-247b-40a2-a54d-433448711a4d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b5b845-0d97-4ce4-9e74-8dfb0c6a076e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbycSxIK {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UbycSxIK" returned: 0 in 0.028s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca62913-846a-42fd-92f3-390911c60cc8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UbycSxIK'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b06e712-55d2-4d53-8408-89800dc10176]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31a85d-53ad-4d3c-b71c-5ef6c5e77996]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01cd869-2099-4df2-a6ff-8d64f2e46349]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]
Jul 27 17:13:38 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c426a-3dfd-410f-a404-505be34006a6]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[10895526-05fe-40a6-8395-d4eb8e0db933]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:13:38 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099f658-cd96-41b1-9068-912ba3f90156]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:13:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:39 user nova-compute[71026]: WARNING nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:39 user nova-compute[71026]: WARNING nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:39 user nova-compute[71026]: WARNING nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:39 user nova-compute[71026]: WARNING nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:39 user nova-compute[71026]: WARNING nova.compute.manager [req-eb06fe94-b1ea-4eae-bc96-1677e78f2da6 req-6817e8d9-cc4b-45da-a4d1-509cb7d1a4c3 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26566393631343634', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566393631343634', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:13:37Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'pci_devices' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:13:39 user nova-compute[71026]:   <uuid>990bca8b-8771-4948-9b3b-3aa6a0c5e39a</uuid>
Jul 27 17:13:39 user nova-compute[71026]:   <name>instance-0000002f</name>
Jul 27 17:13:39 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:13:39 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:13:39 user nova-compute[71026]:   <metadata>
Jul 27 17:13:39 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:13:39 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:name>tempest-TestMinimumBasicScenario-server-1595506423</nova:name>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:13:38</nova:creationTime>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:13:39 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:13:39 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:owner>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:user uuid="820e443fd72d4e2c90a31c8b63ef495c">tempest-TestMinimumBasicScenario-860753275-project-member</nova:user>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:project uuid="789c6f3e53b643728abe414f52d33edc">tempest-TestMinimumBasicScenario-860753275</nova:project>
Jul 27 17:13:39 user nova-compute[71026]:       </nova:owner>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:root type="image" uuid="d9063e01-3f2b-4644-a956-104d09e1d66c"/>
Jul 27 17:13:39 user nova-compute[71026]:       <nova:ports>
Jul 27 17:13:39 user nova-compute[71026]:         <nova:port uuid="43f6d63e-11f8-4a17-968f-774ae5edefa8">
Jul 27 17:13:39 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 27 17:13:39 user nova-compute[71026]:         </nova:port>
Jul 27 17:13:39 user nova-compute[71026]:       </nova:ports>
Jul 27 17:13:39 user nova-compute[71026]:     </nova:instance>
Jul 27 17:13:39 user nova-compute[71026]:   </metadata>
Jul 27 17:13:39 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:13:39 user nova-compute[71026]:     <system>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="serial">990bca8b-8771-4948-9b3b-3aa6a0c5e39a</entry>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="uuid">990bca8b-8771-4948-9b3b-3aa6a0c5e39a</entry>
Jul 27 17:13:39 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:13:39 user nova-compute[71026]:     </system>
Jul 27 17:13:39 user nova-compute[71026]:   </sysinfo>
Jul 27 17:13:39 user nova-compute[71026]:   <os>
Jul 27 17:13:39 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:13:39 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:13:39 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:13:39 user nova-compute[71026]:   </os>
Jul 27 17:13:39 user nova-compute[71026]:   <features>
Jul 27 17:13:39 user nova-compute[71026]:     <acpi/>
Jul 27 17:13:39 user nova-compute[71026]:     <apic/>
Jul 27 17:13:39 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:13:39 user nova-compute[71026]:   </features>
Jul 27 17:13:39 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:13:39 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:13:39 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:13:39 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:13:39 user nova-compute[71026]:   </clock>
Jul 27 17:13:39 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:13:39 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:13:39 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:13:39 user nova-compute[71026]:   </cpu>
Jul 27 17:13:39 user nova-compute[71026]:   <devices>
Jul 27 17:13:39 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:13:39 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:13:39 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk"/>
Jul 27 17:13:39 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:13:39 user nova-compute[71026]:     </disk>
Jul 27 17:13:39 user nova-compute[71026]:     <disk type="block" device="disk">
Jul 27 17:13:39 user nova-compute[71026]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:13:39 user nova-compute[71026]:       <source dev="/dev/sdc"/>
Jul 27 17:13:39 user nova-compute[71026]:       <target dev="vdb" bus="virtio"/>
Jul 27 17:13:39 user nova-compute[71026]:       <serial>6e5a4ab6-474c-4aba-9aa0-06484034fb74</serial>
Jul 27 17:13:39 user nova-compute[71026]:     </disk>
Jul 27 17:13:39 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:13:39 user nova-compute[71026]:       <mac address="fa:16:3e:f1:44:62"/>
Jul 27 17:13:39 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:13:39 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:13:39 user nova-compute[71026]:       <target dev="tap43f6d63e-11"/>
Jul 27 17:13:39 user nova-compute[71026]:     </interface>
Jul 27 17:13:39 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:13:39 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/console.log" append="off"/>
Jul 27 17:13:39 user nova-compute[71026]:     </serial>
Jul 27 17:13:39 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:13:39 user nova-compute[71026]:     <video>
Jul 27 17:13:39 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:13:39 user nova-compute[71026]:     </video>
Jul 27 17:13:39 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:13:39 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:13:39 user nova-compute[71026]:     </rng>
Jul 27 17:13:39 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:13:39 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:13:39 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:13:39 user nova-compute[71026]:     </memballoon>
Jul 27 17:13:39 user nova-compute[71026]:   </devices>
Jul 27 17:13:39 user nova-compute[71026]: </domain>
Jul 27 17:13:39 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'trusted_certs' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fccb086cc3173a9f7bf8546549de637f08a180a2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Cannot resize image /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.objects.instance [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'migration_context' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:13:37Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG os_vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43f6d63e-11, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43f6d63e-11, col_values=(('external_ids', {'iface-id': '43f6d63e-11f8-4a17-968f-774ae5edefa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:44:62', 'vm-uuid': '990bca8b-8771-4948-9b3b-3aa6a0c5e39a'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:13:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:40 user nova-compute[71026]: INFO os_vif [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11')
Jul 27 17:13:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:42 user nova-compute[71026]: WARNING nova.compute.manager [req-19e35aa6-7467-4352-8e03-811e4b564735 req-e9cfe623-a0b3-4ac8-b32f-dec28e2e9e32 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state reboot_started_hard.
Jul 27 17:13:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for 990bca8b-8771-4948-9b3b-3aa6a0c5e39a due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478023.8811512, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:13:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] VM Resumed (Lifecycle Event)
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:13:43 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance rebooted successfully.
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:13:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478023.8827047, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:13:43 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] VM Started (Lifecycle Event)
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:13:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-dca21ccf-d352-4724-a0f3-fc224a7077ac tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.403s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:13:44 user nova-compute[71026]: WARNING nova.compute.manager [req-592b7f66-7843-4966-ab10-ab3e9e17a911 req-c6c91ae0-5070-48d1-ae14-6ce59378aba8 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state active and task_state None.
Jul 27 17:13:44 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:48 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:13:49 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:13:49 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8548MB free_disk=25.288692474365234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 4b351682-2e9b-4010-8782-19b9ff51fa37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:13:49 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:13:50 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:13:51 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [{"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:13:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-476294df-90d7-4caa-810c-e129fac28897" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:13:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:13:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:51 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:13:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:13:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:00 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:14:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:14:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-changed-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG nova.compute.manager [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Refreshing instance network info cache due to event network-changed-bd4e3e56-193a-46d0-ac82-390c6179ddd2. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] Acquiring lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] Acquired lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG nova.network.neutron [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Refreshing network info cache for port bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:41 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:41 user nova-compute[71026]: INFO nova.compute.manager [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Terminating instance
Jul 27 17:14:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-unplugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] No waiting events found dispatching network-vif-unplugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.compute.manager [req-b8181f92-65ef-49ac-adea-b29e9acafad1 req-0197776f-c542-480e-83d5-778807665838 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-unplugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.network.neutron [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updated VIF entry in instance network info cache for port bd4e3e56-193a-46d0-ac82-390c6179ddd2. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.network.neutron [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updating instance_info_cache with network_info: [{"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ccbf7777-85a1-43b3-8779-72dbf45a0a7e req-689d26b6-c5da-439e-bdf5-54daa94ce956 service nova] Releasing lock "refresh_cache-4b351682-2e9b-4010-8782-19b9ff51fa37" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Instance destroyed successfully.
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.objects.instance [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'resources' on Instance uuid 4b351682-2e9b-4010-8782-19b9ff51fa37 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:12:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1767407769',display_name='tempest-AttachVolumeNegativeTest-server-1767407769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1767407769',id=48,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2MRgf7pdXB1qma0L97Z3Ol7mInNJe/Ghqbs1FgQH2wq07je+tCpVmqRYvdsvXzj6xB817BqieJb/5xSDXI4tDctp5RA5ig8GxVQV4hCld4ha2BqZvL1Tkv2KucCc2Ebw==',key_name='tempest-keypair-1679475229',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:12:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-4udp3ohv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=4b351682-2e9b-4010-8782-19b9ff51fa37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "address": "fa:16:3e:89:c7:18", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd4e3e56-19", "ovs_interfaceid": "bd4e3e56-193a-46d0-ac82-390c6179ddd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG os_vif [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd4e3e56-19, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:14:42 user nova-compute[71026]: INFO os_vif [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c7:18,bridge_name='br-int',has_traffic_filtering=True,id=bd4e3e56-193a-46d0-ac82-390c6179ddd2,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd4e3e56-19')
Jul 27 17:14:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Deleting instance files /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37_del
Jul 27 17:14:42 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Deletion of /opt/stack/data/nova/instances/4b351682-2e9b-4010-8782-19b9ff51fa37_del complete
Jul 27 17:14:42 user nova-compute[71026]: INFO nova.compute.manager [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 27 17:14:42 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:14:42 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:14:43 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Took 0.84 seconds to deallocate network for instance.
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-8f4eeaf9-259a-45bd-991d-3c74b3c0af1a req-77d34d87-e3aa-4e94-883c-fc8ca38440a3 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-deleted-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:14:43 user nova-compute[71026]: INFO nova.compute.manager [req-8f4eeaf9-259a-45bd-991d-3c74b3c0af1a req-77d34d87-e3aa-4e94-883c-fc8ca38440a3 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Neutron deleted interface bd4e3e56-193a-46d0-ac82-390c6179ddd2; detaching it from the instance and deleting it from the info cache
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.network.neutron [req-8f4eeaf9-259a-45bd-991d-3c74b3c0af1a req-77d34d87-e3aa-4e94-883c-fc8ca38440a3 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.compute.manager [req-8f4eeaf9-259a-45bd-991d-3c74b3c0af1a req-77d34d87-e3aa-4e94-883c-fc8ca38440a3 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Detach interface failed, port_id=bd4e3e56-193a-46d0-ac82-390c6179ddd2, reason: Instance 4b351682-2e9b-4010-8782-19b9ff51fa37 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:14:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:43 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Deleted allocations for instance 4b351682-2e9b-4010-8782-19b9ff51fa37
Jul 27 17:14:43 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-8d392453-f78f-4b79-9408-e27d397c6267 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.832s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:14:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] Acquiring lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:44 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] Lock "4b351682-2e9b-4010-8782-19b9ff51fa37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:44 user nova-compute[71026]: DEBUG nova.compute.manager [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] No waiting events found dispatching network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:14:44 user nova-compute[71026]: WARNING nova.compute.manager [req-79c0dc03-9a6f-4cdb-91a0-48b9ea48c2a9 req-6aee025a-b086-466c-8d7e-2a848d8484f0 service nova] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Received unexpected event network-vif-plugged-bd4e3e56-193a-46d0-ac82-390c6179ddd2 for instance with vm_state deleted and task_state None.
Jul 27 17:14:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:45 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:14:50 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:14:51 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:14:51 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.315563201904297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:14:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:14:52 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:14:53 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:14:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:14:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:14:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:53 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:14:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:14:57 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478082.5072663, 4b351682-2e9b-4010-8782-19b9ff51fa37 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:14:57 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] VM Stopped (Lifecycle Event)
Jul 27 17:14:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-525a5d81-62ba-4209-b003-5a5f027230ac None None] [instance: 4b351682-2e9b-4010-8782-19b9ff51fa37] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:14:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:15:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing instance network info cache due to event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:15:28 user nova-compute[71026]: DEBUG nova.network.neutron [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:15:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated VIF entry in instance network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:15:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:15:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-67ca9020-e641-4e05-bdf0-16370b4f9b81 req-82f6c02e-5558-4d5e-85e1-8d8e80f74309 service nova] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:15:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.compute.manager [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing instance network info cache due to event network-changed-43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] Acquiring lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] Acquired lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Refreshing network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:15:30 user nova-compute[71026]: INFO nova.compute.manager [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Detaching volume 6e5a4ab6-474c-4aba-9aa0-06484034fb74
Jul 27 17:15:30 user nova-compute[71026]: INFO nova.virt.block_device [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Attempting to driver detach volume 6e5a4ab6-474c-4aba-9aa0-06484034fb74 from mountpoint /dev/vdb
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Attempting to detach device vdb from instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:15:30 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:15:30 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:15:30 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:15:30 user nova-compute[71026]:   <serial>6e5a4ab6-474c-4aba-9aa0-06484034fb74</serial>
Jul 27 17:15:30 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 17:15:30 user nova-compute[71026]: </disk>
Jul 27 17:15:30 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:15:30 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully detached device vdb from instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a from the persistent domain config.
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:15:30 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:15:30 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:15:30 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:15:30 user nova-compute[71026]:   <serial>6e5a4ab6-474c-4aba-9aa0-06484034fb74</serial>
Jul 27 17:15:30 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 27 17:15:30 user nova-compute[71026]: </disk>
Jul 27 17:15:30 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690478130.783691, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updated VIF entry in instance network info cache for port 43f6d63e-11f8-4a17-968f-774ae5edefa8. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.network.neutron [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [{"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:15:30 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully detached device vdb from instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a from the live domain config.
Jul 27 17:15:30 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UbycSxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:15:30 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-ba236a2e-2175-439b-b1f9-6d15aa6e6531 req-65e97806-e057-4ee9-8fed-82c6a2cbeedf service nova] Releasing lock "refresh_cache-990bca8b-8771-4948-9b3b-3aa6a0c5e39a" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da80131-258c-4253-84c5-531099bf1081]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:15:30 user nova-compute[71026]: No targets found.
Jul 27 17:15:30 user nova-compute[71026]: iSNS:
Jul 27 17:15:30 user nova-compute[71026]: No targets found.
Jul 27 17:15:30 user nova-compute[71026]: STATIC:
Jul 27 17:15:30 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74
Jul 27 17:15:30 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:15:30 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:15:30 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030
Jul 27 17:15:30 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:15:30 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:15:30 user nova-compute[71026]: FIRMWARE:
Jul 27 17:15:30 user nova-compute[71026]: No targets found.
Jul 27 17:15:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:15:30 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:15:30 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32140e77-8dbb-4b5e-b49b-63f5c59cd188]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[842557ff-e4da-4726-b5ae-434223699d26]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:15:30 user nova-compute[71026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:15:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:15:30 user nova-compute[71026]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 (non-flash)
Jul 27 17:15:30 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30886c25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531412e-7ef2-4272-b6d8-956812c7cf10]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d8d314-b2d4-4170-8cd4-4bda1659faf2]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b19a0f-17f9-4a5d-ae9d-4c2988a5ab94]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:30 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b90c4f4-e222-4d22-bd91-443d30af0a8f]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f5f79-7d9c-4c6b-bfb2-25089dbc928d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0061276-b329-4964-bdb1-3a3faeb2014e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260]
Jul 27 17:15:31 user nova-compute[71026]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74, portal: 172.16.0.220,3260] successful.
Jul 27 17:15:31 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e5a4ab6-474c-4aba-9aa0-06484034fb74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ace00f-6569-492c-aae2-fc846cb4f558]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== disconnect_volume: return (304ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG nova.objects.instance [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:15:31 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-41152c1f-1ecf-4f6e-88ba-df752f9ba87d tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:15:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:15:33 user nova-compute[71026]: INFO nova.compute.manager [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Detaching volume 28335e0d-c430-461d-a821-05b3c9855030
Jul 27 17:15:33 user nova-compute[71026]: INFO nova.virt.block_device [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Attempting to driver detach volume 28335e0d-c430-461d-a821-05b3c9855030 from mountpoint /dev/vdb
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Attempting to detach device vdb from instance 476294df-90d7-4caa-810c-e129fac28897 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:15:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:15:33 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:15:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:15:33 user nova-compute[71026]:   <serial>28335e0d-c430-461d-a821-05b3c9855030</serial>
Jul 27 17:15:33 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:15:33 user nova-compute[71026]: </disk>
Jul 27 17:15:33 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:15:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 476294df-90d7-4caa-810c-e129fac28897 from the persistent domain config.
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 476294df-90d7-4caa-810c-e129fac28897 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:15:33 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:15:33 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:15:33 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:15:33 user nova-compute[71026]:   <serial>28335e0d-c430-461d-a821-05b3c9855030</serial>
Jul 27 17:15:33 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:15:33 user nova-compute[71026]: </disk>
Jul 27 17:15:33 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690478133.9502673, 476294df-90d7-4caa-810c-e129fac28897 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:15:33 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 476294df-90d7-4caa-810c-e129fac28897 from the live domain config.
Jul 27 17:15:33 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCpqgjZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:15:33 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d14d7de-cb83-4bc2-b7ed-e9a57fb2cf57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:15:33 user nova-compute[71026]: No targets found.
Jul 27 17:15:33 user nova-compute[71026]: iSNS:
Jul 27 17:15:33 user nova-compute[71026]: No targets found.
Jul 27 17:15:33 user nova-compute[71026]: STATIC:
Jul 27 17:15:33 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030
Jul 27 17:15:33 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:15:33 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:15:33 user nova-compute[71026]: FIRMWARE:
Jul 27 17:15:33 user nova-compute[71026]: No targets found.
Jul 27 17:15:33 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:15:33 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:15:33 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:15:33 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[67570a0a-fe19-4985-8167-2f959d7ed799]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[02072572-3de0-46aa-8dae-4cb7dce2c754]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:15:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 (non-flash)
Jul 27 17:15:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f306851a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cfc0b-618a-45e3-a8f4-11b9c4fdae72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa3488-204d-489a-bf5d-b4a2df256c27]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49cdeb1-2a02-45e7-b61e-e94f049d74dc]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6e5214-50d9-4d51-a834-b81032f243be]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bb671b-86bd-43fa-ac5b-d30a3ef60a95]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a1a1d-8adc-4080-905d-2b4c84bee896]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260]
Jul 27 17:15:34 user nova-compute[71026]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030, portal: 172.16.0.220,3260] successful.
Jul 27 17:15:34 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28335e0d-c430-461d-a821-05b3c9855030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[917010f8-9a35-45cd-93f1-f3a1b1914492]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== disconnect_volume: return (276ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:15:34 user nova-compute[71026]: DEBUG nova.objects.instance [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:15:35 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-a5fbd03b-4aee-4dcb-ba7f-7a3527b67793 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:15:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:46 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:15:51 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:15:52 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:15:52 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=25.314552307128906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 476294df-90d7-4caa-810c-e129fac28897 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:15:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:15:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:15:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:15:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:15:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:15:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:16:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:16:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:16:16 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:16:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:23 user nova-compute[71026]: INFO nova.compute.manager [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Terminating instance
Jul 27 17:16:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:16:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-unplugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] No waiting events found dispatching network-vif-unplugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-62e93276-ad8c-4f04-91dc-4b49d49f849a req-489f26ab-87da-404a-9d94-4c4a323fe821 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-unplugged-fcf3840c-4db8-454e-b31b-9feaf6750cda for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] Instance destroyed successfully.
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.objects.instance [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'resources' on Instance uuid 476294df-90d7-4caa-810c-e129fac28897 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:10:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1518504960',display_name='tempest-AttachVolumeNegativeTest-server-1518504960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1518504960',id=46,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbvoHxjoYHTFqJ9ySlGs9RiCXmjvOUsZzS8N5WXkaSwEcHDShL0JuGA9WGrKPh3T0EscM062LgFnYuNIDvv7rNGcCDR50gOZ6dfbE0YIKbXcl965O+LfLV2TvgaB8gMTA==',key_name='tempest-keypair-1994588440',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-jc3ugci0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=476294df-90d7-4caa-810c-e129fac28897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "address": "fa:16:3e:5b:6a:3b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf3840c-4d", "ovs_interfaceid": "fcf3840c-4db8-454e-b31b-9feaf6750cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG os_vif [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf3840c-4d, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:16:24 user nova-compute[71026]: INFO os_vif [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:6a:3b,bridge_name='br-int',has_traffic_filtering=True,id=fcf3840c-4db8-454e-b31b-9feaf6750cda,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf3840c-4d')
Jul 27 17:16:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Deleting instance files /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897_del
Jul 27 17:16:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Deletion of /opt/stack/data/nova/instances/476294df-90d7-4caa-810c-e129fac28897_del complete
Jul 27 17:16:24 user nova-compute[71026]: INFO nova.compute.manager [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 476294df-90d7-4caa-810c-e129fac28897] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 27 17:16:24 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:16:24 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:16:25 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] Took 0.86 seconds to deallocate network for instance.
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f8150ab-a622-4afb-a14b-283062634f35 req-6939da69-c955-4eae-8928-909354edeef8 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-deleted-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:25 user nova-compute[71026]: INFO nova.compute.manager [req-5f8150ab-a622-4afb-a14b-283062634f35 req-6939da69-c955-4eae-8928-909354edeef8 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Neutron deleted interface fcf3840c-4db8-454e-b31b-9feaf6750cda; detaching it from the instance and deleting it from the info cache
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-5f8150ab-a622-4afb-a14b-283062634f35 req-6939da69-c955-4eae-8928-909354edeef8 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-5f8150ab-a622-4afb-a14b-283062634f35 req-6939da69-c955-4eae-8928-909354edeef8 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Detach interface failed, port_id=fcf3840c-4db8-454e-b31b-9feaf6750cda, reason: Instance 476294df-90d7-4caa-810c-e129fac28897 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:16:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:25 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Deleted allocations for instance 476294df-90d7-4caa-810c-e129fac28897
Jul 27 17:16:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-0cab28be-028e-4661-b040-45aaa73898d4 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "476294df-90d7-4caa-810c-e129fac28897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.010s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:26 user nova-compute[71026]: INFO nova.compute.manager [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Terminating instance
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] Acquiring lock "476294df-90d7-4caa-810c-e129fac28897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] Lock "476294df-90d7-4caa-810c-e129fac28897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] No waiting events found dispatching network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:26 user nova-compute[71026]: WARNING nova.compute.manager [req-9b24908b-4d2d-4ff1-929d-fb0a1ab08f64 req-c4fe1cd2-cee1-4564-85f3-4e65f6550032 service nova] [instance: 476294df-90d7-4caa-810c-e129fac28897] Received unexpected event network-vif-plugged-fcf3840c-4db8-454e-b31b-9feaf6750cda for instance with vm_state deleted and task_state None.
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Instance destroyed successfully.
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'resources' on Instance uuid 990bca8b-8771-4948-9b3b-3aa6a0c5e39a {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:11:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1595506423',display_name='tempest-TestMinimumBasicScenario-server-1595506423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1595506423',id=47,image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz7w03gHvGhCaGpdeqLNf2hSS7Ea9HJgISQiOezHwiqmW+DYT9qqzBcmRwqPAs5FL6U5iTPdwc/0hy0bEiHelaSexa3egzSfxC2dTHFDst6O3Gf/c5kV18Z5K5R7o/+aQ==',key_name='tempest-TestMinimumBasicScenario-653938057',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:11:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-0f9y5axy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d9063e01-3f2b-4644-a956-104d09e1d66c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:13:44Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=990bca8b-8771-4948-9b3b-3aa6a0c5e39a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "address": "fa:16:3e:f1:44:62", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f6d63e-11", "ovs_interfaceid": "43f6d63e-11f8-4a17-968f-774ae5edefa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG os_vif [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43f6d63e-11, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:16:26 user nova-compute[71026]: INFO os_vif [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:44:62,bridge_name='br-int',has_traffic_filtering=True,id=43f6d63e-11f8-4a17-968f-774ae5edefa8,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f6d63e-11')
Jul 27 17:16:26 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Deleting instance files /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a_del
Jul 27 17:16:26 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Deletion of /opt/stack/data/nova/instances/990bca8b-8771-4948-9b3b-3aa6a0c5e39a_del complete
Jul 27 17:16:26 user nova-compute[71026]: INFO nova.compute.manager [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 27 17:16:26 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:16:26 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:16:27 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Took 0.70 seconds to deallocate network for instance.
Jul 27 17:16:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-d0fa6e18-3f30-4a76-a49b-32f086ffb7c4 req-485ca846-6a36-4a31-9bf8-1917287cdeed service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-deleted-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:16:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:27 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Deleted allocations for instance 990bca8b-8771-4948-9b3b-3aa6a0c5e39a
Jul 27 17:16:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d80f6a6d-e3d5-4fb1-9c4b-2e833a1dd0cf tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.893s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-unplugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Acquiring lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] Lock "990bca8b-8771-4948-9b3b-3aa6a0c5e39a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] No waiting events found dispatching network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:16:28 user nova-compute[71026]: WARNING nova.compute.manager [req-1c287b91-764a-450e-98fc-b42a876aff66 req-e878f333-4943-4cc1-81ad-130e6b054b4b service nova] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Received unexpected event network-vif-plugged-43f6d63e-11f8-4a17-968f-774ae5edefa8 for instance with vm_state deleted and task_state None.
Jul 27 17:16:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:36 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:39 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478184.6560485, 476294df-90d7-4caa-810c-e129fac28897 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:16:39 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 476294df-90d7-4caa-810c-e129fac28897] VM Stopped (Lifecycle Event)
Jul 27 17:16:39 user nova-compute[71026]: DEBUG nova.compute.manager [None req-361369a1-5236-4ac5-bb3c-49019c4bccba None None] [instance: 476294df-90d7-4caa-810c-e129fac28897] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:16:41 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478186.846929, 990bca8b-8771-4948-9b3b-3aa6a0c5e39a => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:16:41 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] VM Stopped (Lifecycle Event)
Jul 27 17:16:41 user nova-compute[71026]: DEBUG nova.compute.manager [None req-0a98e03a-817f-4c54-8335-6a3938bdc249 None None] [instance: 990bca8b-8771-4948-9b3b-3aa6a0c5e39a] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:16:41 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:16:46 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:47 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:48 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:16:51 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:16:51 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.36953353881836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:16:51 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:16:52 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:16:52 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:16:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:16:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:16:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:16:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:16:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:16:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:16:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:16:56 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:16:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:17:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:06 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:17:17 user nova-compute[71026]: INFO nova.compute.claims [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Claim successful on node user
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:17:17 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:17:17 user nova-compute[71026]: DEBUG nova.policy [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32fb8f31ad924af19499c72671d0cfd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755fc60deefd4468a017742d1a5f922e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:17:18 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Creating image(s)
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "/opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.158s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk 1073741824" returned: 0 in 0.077s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.147s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Cannot resize image /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'migration_context' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Ensure instance console log exists: /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:18 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Successfully created port: 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Successfully updated port: 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquired lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-changed-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.compute.manager [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Refreshing instance network info cache due to event network-changed-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] Acquiring lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:17:19 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Releasing lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Instance network_info: |[{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] Acquired lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Refreshing network info cache for port 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Start _get_guest_xml network_info=[{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:17:20 user nova-compute[71026]: INFO nova.compute.claims [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Claim successful on node user
Jul 27 17:17:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:20 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981659796',display_name='tempest-AttachVolumeNegativeTest-server-1981659796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1981659796',id=49,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPYDMx7Oa2NFQztKShQgkxryMFn/o3tkqDlkAqyjniF4hGwJ0OC9oXJzJRgvsMmaUOAZU1Pg4EbDKO7oRT2qpF6l+Ez2MuTq8zifrHOPMjeCvFmtd5IFJnzxS/cKcstAQ==',key_name='tempest-keypair-557337629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-miv3f6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=51a787e5-d9ef-4fe2-a899-b214b6efa139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.objects.instance [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'pci_devices' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:17:20 user nova-compute[71026]:   <uuid>51a787e5-d9ef-4fe2-a899-b214b6efa139</uuid>
Jul 27 17:17:20 user nova-compute[71026]:   <name>instance-00000031</name>
Jul 27 17:17:20 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:17:20 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:17:20 user nova-compute[71026]:   <metadata>
Jul 27 17:17:20 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:17:20 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1981659796</nova:name>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:17:20</nova:creationTime>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:17:20 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:17:20 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:owner>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:user uuid="32fb8f31ad924af19499c72671d0cfd4">tempest-AttachVolumeNegativeTest-881744709-project-member</nova:user>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:project uuid="755fc60deefd4468a017742d1a5f922e">tempest-AttachVolumeNegativeTest-881744709</nova:project>
Jul 27 17:17:20 user nova-compute[71026]:       </nova:owner>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:17:20 user nova-compute[71026]:       <nova:ports>
Jul 27 17:17:20 user nova-compute[71026]:         <nova:port uuid="534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1">
Jul 27 17:17:20 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 27 17:17:20 user nova-compute[71026]:         </nova:port>
Jul 27 17:17:20 user nova-compute[71026]:       </nova:ports>
Jul 27 17:17:20 user nova-compute[71026]:     </nova:instance>
Jul 27 17:17:20 user nova-compute[71026]:   </metadata>
Jul 27 17:17:20 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:17:20 user nova-compute[71026]:     <system>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="serial">51a787e5-d9ef-4fe2-a899-b214b6efa139</entry>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="uuid">51a787e5-d9ef-4fe2-a899-b214b6efa139</entry>
Jul 27 17:17:20 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:17:20 user nova-compute[71026]:     </system>
Jul 27 17:17:20 user nova-compute[71026]:   </sysinfo>
Jul 27 17:17:20 user nova-compute[71026]:   <os>
Jul 27 17:17:20 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:17:20 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:17:20 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:17:20 user nova-compute[71026]:   </os>
Jul 27 17:17:20 user nova-compute[71026]:   <features>
Jul 27 17:17:20 user nova-compute[71026]:     <acpi/>
Jul 27 17:17:20 user nova-compute[71026]:     <apic/>
Jul 27 17:17:20 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:17:20 user nova-compute[71026]:   </features>
Jul 27 17:17:20 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:17:20 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:17:20 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:17:20 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:17:20 user nova-compute[71026]:   </clock>
Jul 27 17:17:20 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:17:20 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:17:20 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:17:20 user nova-compute[71026]:   </cpu>
Jul 27 17:17:20 user nova-compute[71026]:   <devices>
Jul 27 17:17:20 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:17:20 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:17:20 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk"/>
Jul 27 17:17:20 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:17:20 user nova-compute[71026]:     </disk>
Jul 27 17:17:20 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:17:20 user nova-compute[71026]:       <mac address="fa:16:3e:3f:8f:f3"/>
Jul 27 17:17:20 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:17:20 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:17:20 user nova-compute[71026]:       <target dev="tap534e77f8-19"/>
Jul 27 17:17:20 user nova-compute[71026]:     </interface>
Jul 27 17:17:20 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:17:20 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/console.log" append="off"/>
Jul 27 17:17:20 user nova-compute[71026]:     </serial>
Jul 27 17:17:20 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:17:20 user nova-compute[71026]:     <video>
Jul 27 17:17:20 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:17:20 user nova-compute[71026]:     </video>
Jul 27 17:17:20 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:17:20 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:17:20 user nova-compute[71026]:     </rng>
Jul 27 17:17:20 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:17:20 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:17:20 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:17:20 user nova-compute[71026]:     </memballoon>
Jul 27 17:17:20 user nova-compute[71026]:   </devices>
Jul 27 17:17:20 user nova-compute[71026]: </domain>
Jul 27 17:17:20 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981659796',display_name='tempest-AttachVolumeNegativeTest-server-1981659796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1981659796',id=49,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPYDMx7Oa2NFQztKShQgkxryMFn/o3tkqDlkAqyjniF4hGwJ0OC9oXJzJRgvsMmaUOAZU1Pg4EbDKO7oRT2qpF6l+Ez2MuTq8zifrHOPMjeCvFmtd5IFJnzxS/cKcstAQ==',key_name='tempest-keypair-557337629',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-miv3f6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=51a787e5-d9ef-4fe2-a899-b214b6efa139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG os_vif [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap534e77f8-19, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap534e77f8-19, col_values=(('external_ids', {'iface-id': '534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:8f:f3', 'vm-uuid': '51a787e5-d9ef-4fe2-a899-b214b6efa139'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:20 user nova-compute[71026]: INFO os_vif [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19')
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:3f:8f:f3, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:17:20 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.policy [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '820e443fd72d4e2c90a31c8b63ef495c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '789c6f3e53b643728abe414f52d33edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:17:20 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Creating image(s)
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "/opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "/opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.part --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updated VIF entry in instance network info cache for port 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8ea9551d-f72c-46ce-a7d8-95f377514a2a req-5a9e23ad-c2d8-4ea7-b520-df465426613e service nova] Releasing lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.part --force-share --output=json" returned: 0 in 0.129s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG nova.virt.images [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] 2e7fe1b3-3c8f-413e-be33-25db21950413 was qcow2, converting to raw {{(pid=71026) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG nova.privsep.utils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71026) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.part /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.converted {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.part /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.converted" returned: 0 in 0.220s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.converted --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Successfully created port: c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.871s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json" returned: 0 in 0.128s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:21 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json" returned: 0 in 0.173s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977,backing_fmt=raw /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977,backing_fmt=raw /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk 1073741824" returned: 0 in 0.053s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "05762d71bcb7fa6226e3fdb000ed296826a1a977" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05762d71bcb7fa6226e3fdb000ed296826a1a977 --force-share --output=json" returned: 0 in 0.157s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Cannot resize image /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'migration_context' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Ensure instance console log exists: /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] No waiting events found dispatching network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:17:22 user nova-compute[71026]: WARNING nova.compute.manager [req-74947b4a-2624-4e2d-9076-5d63caabc416 req-eea82246-3f00-4331-ac78-a81dc2b37db3 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received unexpected event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 for instance with vm_state building and task_state spawning.
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Successfully updated port: c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.neutron [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance network_info: |[{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Start _get_guest_xml network_info=[{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:17:17Z,direct_url=<?>,disk_format='qcow2',id=2e7fe1b3-3c8f-413e-be33-25db21950413,min_disk=0,min_ram=0,name='tempest-scenario-img--1107017343',owner='789c6f3e53b643728abe414f52d33edc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:17:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '2e7fe1b3-3c8f-413e-be33-25db21950413'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:17:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:23 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T17:17:17Z,direct_url=<?>,disk_format='qcow2',id=2e7fe1b3-3c8f-413e-be33-25db21950413,min_disk=0,min_ram=0,name='tempest-scenario-img--1107017343',owner='789c6f3e53b643728abe414f52d33edc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T17:17:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1559789036',display_name='tempest-TestMinimumBasicScenario-server-1559789036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1559789036',id=50,image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbf7gye6yr7Jr9RhSd897J/b23p1dZalN8LZ/E+KdxuRkB3/B41m+PhcNoJRZmNOwRoy/zLlpHLxEBZCtCzpgBzDGWRtA8qpHY2Lx828bxusKZQgF8djJ0NtGt6obg39A==',key_name='tempest-TestMinimumBasicScenario-1175109659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-62tagehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:17:21Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=c3b2f425-b988-4b5d-8b56-f403501465fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'pci_devices' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:17:23 user nova-compute[71026]:   <uuid>c3b2f425-b988-4b5d-8b56-f403501465fb</uuid>
Jul 27 17:17:23 user nova-compute[71026]:   <name>instance-00000032</name>
Jul 27 17:17:23 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:17:23 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:17:23 user nova-compute[71026]:   <metadata>
Jul 27 17:17:23 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:17:23 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:name>tempest-TestMinimumBasicScenario-server-1559789036</nova:name>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:17:23</nova:creationTime>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:17:23 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:17:23 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:owner>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:user uuid="820e443fd72d4e2c90a31c8b63ef495c">tempest-TestMinimumBasicScenario-860753275-project-member</nova:user>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:project uuid="789c6f3e53b643728abe414f52d33edc">tempest-TestMinimumBasicScenario-860753275</nova:project>
Jul 27 17:17:23 user nova-compute[71026]:       </nova:owner>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:root type="image" uuid="2e7fe1b3-3c8f-413e-be33-25db21950413"/>
Jul 27 17:17:23 user nova-compute[71026]:       <nova:ports>
Jul 27 17:17:23 user nova-compute[71026]:         <nova:port uuid="c1575975-d9c1-4aad-9323-45824e6f2c98">
Jul 27 17:17:23 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 27 17:17:23 user nova-compute[71026]:         </nova:port>
Jul 27 17:17:23 user nova-compute[71026]:       </nova:ports>
Jul 27 17:17:23 user nova-compute[71026]:     </nova:instance>
Jul 27 17:17:23 user nova-compute[71026]:   </metadata>
Jul 27 17:17:23 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:17:23 user nova-compute[71026]:     <system>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="serial">c3b2f425-b988-4b5d-8b56-f403501465fb</entry>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="uuid">c3b2f425-b988-4b5d-8b56-f403501465fb</entry>
Jul 27 17:17:23 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:17:23 user nova-compute[71026]:     </system>
Jul 27 17:17:23 user nova-compute[71026]:   </sysinfo>
Jul 27 17:17:23 user nova-compute[71026]:   <os>
Jul 27 17:17:23 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:17:23 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:17:23 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:17:23 user nova-compute[71026]:   </os>
Jul 27 17:17:23 user nova-compute[71026]:   <features>
Jul 27 17:17:23 user nova-compute[71026]:     <acpi/>
Jul 27 17:17:23 user nova-compute[71026]:     <apic/>
Jul 27 17:17:23 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:17:23 user nova-compute[71026]:   </features>
Jul 27 17:17:23 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:17:23 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:17:23 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:17:23 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:17:23 user nova-compute[71026]:   </clock>
Jul 27 17:17:23 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:17:23 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:17:23 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:17:23 user nova-compute[71026]:   </cpu>
Jul 27 17:17:23 user nova-compute[71026]:   <devices>
Jul 27 17:17:23 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:17:23 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:17:23 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk"/>
Jul 27 17:17:23 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:17:23 user nova-compute[71026]:     </disk>
Jul 27 17:17:23 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:17:23 user nova-compute[71026]:       <mac address="fa:16:3e:c4:26:09"/>
Jul 27 17:17:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:17:23 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:17:23 user nova-compute[71026]:       <target dev="tapc1575975-d9"/>
Jul 27 17:17:23 user nova-compute[71026]:     </interface>
Jul 27 17:17:23 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:17:23 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/console.log" append="off"/>
Jul 27 17:17:23 user nova-compute[71026]:     </serial>
Jul 27 17:17:23 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:17:23 user nova-compute[71026]:     <video>
Jul 27 17:17:23 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:17:23 user nova-compute[71026]:     </video>
Jul 27 17:17:23 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:17:23 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:17:23 user nova-compute[71026]:     </rng>
Jul 27 17:17:23 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:17:23 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:17:23 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:17:23 user nova-compute[71026]:     </memballoon>
Jul 27 17:17:23 user nova-compute[71026]:   </devices>
Jul 27 17:17:23 user nova-compute[71026]: </domain>
Jul 27 17:17:23 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1559789036',display_name='tempest-TestMinimumBasicScenario-server-1559789036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1559789036',id=50,image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbf7gye6yr7Jr9RhSd897J/b23p1dZalN8LZ/E+KdxuRkB3/B41m+PhcNoJRZmNOwRoy/zLlpHLxEBZCtCzpgBzDGWRtA8qpHY2Lx828bxusKZQgF8djJ0NtGt6obg39A==',key_name='tempest-TestMinimumBasicScenario-1175109659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-62tagehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:17:21Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=c3b2f425-b988-4b5d-8b56-f403501465fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG os_vif [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1575975-d9, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1575975-d9, col_values=(('external_ids', {'iface-id': 'c1575975-d9c1-4aad-9323-45824e6f2c98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:26:09', 'vm-uuid': 'c3b2f425-b988-4b5d-8b56-f403501465fb'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:23 user nova-compute[71026]: INFO os_vif [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9')
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:17:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No VIF found with MAC fa:16:3e:c4:26:09, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478244.1111255, 51a787e5-d9ef-4fe2-a899-b214b6efa139 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] VM Resumed (Lifecycle Event)
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Instance spawned successfully.
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478244.1125724, 51a787e5-d9ef-4fe2-a899-b214b6efa139 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] VM Started (Lifecycle Event)
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:24 user nova-compute[71026]: INFO nova.compute.manager [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Took 6.72 seconds to build instance.
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-9c2df5ad-5e37-44a4-86df-630c5aa19858 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.814s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] No waiting events found dispatching network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:17:24 user nova-compute[71026]: WARNING nova.compute.manager [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received unexpected event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 for instance with vm_state active and task_state None.
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing instance network info cache due to event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG nova.network.neutron [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG nova.compute.manager [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:17:25 user nova-compute[71026]: WARNING nova.compute.manager [req-5eaed375-8b90-4380-abb8-57603346fa47 req-43084a3b-8674-45d3-891f-aa9da5745ccb service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state building and task_state spawning.
Jul 27 17:17:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated VIF entry in instance network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG nova.network.neutron [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-4aba38d5-e5e2-4f63-916c-69a34479533d req-c9da6ed3-b087-4708-a3d3-3e9d544a4663 service nova] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:17:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478247.1467526, c3b2f425-b988-4b5d-8b56-f403501465fb => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] VM Resumed (Lifecycle Event)
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance spawned successfully.
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478247.1486797, c3b2f425-b988-4b5d-8b56-f403501465fb => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] VM Started (Lifecycle Event)
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Took 6.42 seconds to spawn the instance on the hypervisor.
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:27 user nova-compute[71026]: DEBUG nova.compute.manager [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:17:27 user nova-compute[71026]: WARNING nova.compute.manager [req-61c7e327-7b17-4e0a-a67b-4c6c2644660b req-29f389d6-4256-4fce-9191-df862dcde9e6 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state building and task_state spawning.
Jul 27 17:17:27 user nova-compute[71026]: INFO nova.compute.manager [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Took 7.04 seconds to build instance.
Jul 27 17:17:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-5c606359-c5cf-4026-b3a1-28d8d14bd4f5 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.205s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:17:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:48 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:17:52 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:17:53 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:53 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.28998565673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance c3b2f425-b988-4b5d-8b56-f403501465fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:17:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:17:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:17:55 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:17:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:17:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:17:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:18:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:18:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:50 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:18:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:18:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:18:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=25.28911590576172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance c3b2f425-b988-4b5d-8b56-f403501465fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:18:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:18:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:18:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:18:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:18:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:18:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:18:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:18:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:18:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:18:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:01 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:07 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-changed-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG nova.compute.manager [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Refreshing instance network info cache due to event network-changed-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] Acquiring lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] Acquired lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG nova.network.neutron [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Refreshing network info cache for port 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG nova.network.neutron [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updated VIF entry in instance network info cache for port 534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:19:08 user nova-compute[71026]: DEBUG nova.network.neutron [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:19:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-60bc8998-a993-4269-97d2-a6c196046a4d req-d77a8a4a-06d2-48ad-aada-67cab0d0ac28 service nova] Releasing lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:19:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:13 user nova-compute[71026]: INFO nova.compute.manager [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Attaching volume b110e961-08ec-4a77-a8a7-c320d9840eb5 to /dev/vdb
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.utils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7212f769-9c29-4916-988c-109a7776e1c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a3dc79-4d10-4ce4-9d32-633c79fdf156]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[916fe0dc-4dda-4d07-8abc-843c56ab5a94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9cc1e4-ac4f-497b-a900-f4b8fb96b339]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:19:13 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:19:13 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[712cdc35-c4b5-4924-a1e7-3d964909233b]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG os_brick.utils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:19:13 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating existing volume attachment record: 8692ac35-2bb4-4ea3-b63c-34bc890eb5da {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:19:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:15 user nova-compute[71026]: INFO nova.compute.manager [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Attaching volume 1f733ad6-00d5-4371-92ed-82fbef1b8372 to /dev/vdb
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.utils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0eecb-a1e7-444b-b52d-b078737b4184]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebafc80-4b86-42bf-8510-8d452345e737]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd17c957-a63f-44d9-964f-af1479dfb04e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ac2a47-50e1-4985-b9da-3e8cddf27b9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:19:15 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:19:15 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759c205-3724-4677-8fff-36676c7b3190]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG os_brick.utils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:19:15 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating existing volume attachment record: f71f5d50-4d4b-45a0-8e50-03e1198c047e {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:19:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oADhHXyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:19:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:19:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:19:20 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6303a-e5b8-474a-812a-8bd1477578fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:19:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd4207c-8f4a-42d7-9c45-0d005d3e6b0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5] added
Jul 27 17:19:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de8ae38-28db-4bf9-bda3-25f8e459f004]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[652423eb-6266-4be5-9fd3-f834cc9c9ace]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oADhHXyv {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oADhHXyv" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a84b1d2-8a42-47b8-a65e-62453c6cd7ab]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oADhHXyv'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88d511a-3617-485c-92af-9e49c3ccef6f]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[686fb7e3-7a3e-4554-9867-c37cefdf6170]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:19:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:19:20 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:19:20 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 17:19:20 user nova-compute[71026]: 
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f513f97-69f8-4888-ac8a-3848b246d3ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260]
Jul 27 17:19:20 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260] successful.
Jul 27 17:19:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfe1bed-6c1e-4012-8043-69715197485d]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[62468bef-dc22-4283-9b88-8f61f66d1cd9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:20 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[16611744-debf-489c-aa2c-3cfe2983c5d4]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:20 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oADhHXyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '26231306231306131', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231306231306131', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG nova.objects.instance [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:19:21 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:19:21 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:19:21 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:19:21 user nova-compute[71026]:   <serial>b110e961-08ec-4a77-a8a7-c320d9840eb5</serial>
Jul 27 17:19:21 user nova-compute[71026]: </disk>
Jul 27 17:19:21 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsFAZbRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:19:22 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:19:22 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:19:22 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ed4fe-2379-4286-9683-feae164434cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:19:22 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4353e7fb-bd43-4748-9548-a20c7ca6fa16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372] added
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75d005f-b4e1-40b0-a8a2-5d2126367a31]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[495ec938-1715-48af-a340-63e80c434d8e]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsFAZbRy {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GsFAZbRy" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[329de24b-7c06-4583-8da9-e9a09c8839d8]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GsFAZbRy'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:3f:8f:f3, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c082670-ac7a-4161-afa7-c9a13bbcbe96]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4659a7-8d02-481c-9f48-c505f91ae16d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[58077949-f99d-43bc-a3fc-35b692824676]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260]
Jul 27 17:19:22 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260] successful.
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64116b4-a6a2-4ab8-9ec7-83ed7cd0bf2a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-000468ff-ae94-4816-8918-37d9b36760c8 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.894s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3db0136-3d90-4ae9-8259-864759d5d4e8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:19:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7176e0-8f34-4d44-a681-51dde39bbc33]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:19:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsFAZbRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23437653261396362', 'path': '/dev/sdc'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437653261396362', 'path': '/dev/sdc'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:19:23 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:19:23 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:19:23 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:19:23 user nova-compute[71026]:   <serial>1f733ad6-00d5-4371-92ed-82fbef1b8372</serial>
Jul 27 17:19:23 user nova-compute[71026]: </disk>
Jul 27 17:19:23 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:23 user nova-compute[71026]: INFO nova.compute.manager [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Detaching volume b110e961-08ec-4a77-a8a7-c320d9840eb5
Jul 27 17:19:23 user nova-compute[71026]: INFO nova.virt.block_device [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Attempting to driver detach volume b110e961-08ec-4a77-a8a7-c320d9840eb5 from mountpoint /dev/vdb
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Attempting to detach device vdb from instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:19:23 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:19:23 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:19:23 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:19:23 user nova-compute[71026]:   <serial>b110e961-08ec-4a77-a8a7-c320d9840eb5</serial>
Jul 27 17:19:23 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:19:23 user nova-compute[71026]: </disk>
Jul 27 17:19:23 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:19:23 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 from the persistent domain config.
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:19:23 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:19:23 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:19:23 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:19:23 user nova-compute[71026]:   <serial>b110e961-08ec-4a77-a8a7-c320d9840eb5</serial>
Jul 27 17:19:23 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:19:23 user nova-compute[71026]: </disk>
Jul 27 17:19:23 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:19:23 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] No VIF found with MAC fa:16:3e:c4:26:09, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6bae7d5f-a3cb-418a-bd81-0f6f64435bbb tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.753s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690478364.1604903, 51a787e5-d9ef-4fe2-a899-b214b6efa139 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:19:24 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 from the live domain config.
Jul 27 17:19:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oADhHXyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:19:24 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b074cd-3a49-4129-a8c1-45d597079372]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:19:24 user nova-compute[71026]: No targets found.
Jul 27 17:19:24 user nova-compute[71026]: iSNS:
Jul 27 17:19:24 user nova-compute[71026]: No targets found.
Jul 27 17:19:24 user nova-compute[71026]: STATIC:
Jul 27 17:19:24 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372
Jul 27 17:19:24 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:19:24 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:19:24 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5
Jul 27 17:19:24 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:19:24 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:19:24 user nova-compute[71026]: FIRMWARE:
Jul 27 17:19:24 user nova-compute[71026]: No targets found.
Jul 27 17:19:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:19:24 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:19:24 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11276de-2eb6-4457-a831-7efabb894355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eb6ed1-ecb4-450c-8bd8-e3ad5709c521]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:24 user nova-compute[71026]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:19:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 (non-flash)
Jul 27 17:19:24 user nova-compute[71026]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:19:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3088679d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86fec6-5ae2-4e83-a913-3e62b16cc3ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac9388c-c3b6-4151-9472-0f813deed813]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e862c-7d26-4563-8f80-56051d16813c]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5441fdc-0d26-4650-b6b3-d0c995697323]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178645c-c2d5-439f-9b17-1468114a8eb2]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e215331-eb6d-4c9f-ae39-67d7aae1dbd4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260]
Jul 27 17:19:24 user nova-compute[71026]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5, portal: 172.16.0.220,3260] successful.
Jul 27 17:19:24 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b110e961-08ec-4a77-a8a7-c320d9840eb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[738641a9-8f16-4079-9f17-984475525469]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== disconnect_volume: return (289ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:19:24 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:19:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:25 user nova-compute[71026]: DEBUG nova.objects.instance [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:25 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-46b805e3-1322-45e9-a00b-a4cdde226580 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.644s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:26 user nova-compute[71026]: DEBUG nova.compute.manager [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing instance network info cache due to event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:19:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:19:26 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:19:26 user nova-compute[71026]: DEBUG nova.network.neutron [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:19:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated VIF entry in instance network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:19:27 user nova-compute[71026]: DEBUG nova.network.neutron [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:19:27 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-3578a15d-d4c8-49da-b6d8-5aed6c4e5594 req-5b3eaf56-ab40-415c-9f85-c869e487a5e7 service nova] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG nova.compute.manager [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing instance network info cache due to event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:19:28 user nova-compute[71026]: DEBUG nova.network.neutron [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:29 user nova-compute[71026]: INFO nova.compute.manager [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Rebooting instance
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated VIF entry in instance network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG nova.network.neutron [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d4fc3eb7-3bc2-4c7e-acfe-249e0ac919de req-b4e6e67b-320b-4769-80d8-9aa7bdd8e7ab service nova] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG nova.network.neutron [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:19:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:19:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:31 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:32 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:32 user nova-compute[71026]: DEBUG nova.compute.manager [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:19:32 user nova-compute[71026]: WARNING nova.compute.manager [req-0f0dfd57-cf1d-4745-b88a-70973066a61d req-a20a002d-4b79-4d79-9a57-6a765be322b8 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state active and task_state reboot_started.
Jul 27 17:19:32 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance shutdown successfully.
Jul 27 17:19:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:19:34 user nova-compute[71026]: WARNING nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state active and task_state reboot_started.
Jul 27 17:19:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:19:34 user nova-compute[71026]: WARNING nova.compute.manager [req-bc75d906-0f0f-4fa3-b6fe-6be6abf1ec77 req-266192be-6a5b-49a7-bd21-9925dcde1f9b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state active and task_state reboot_started.
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Removed pending event for c3b2f425-b988-4b5d-8b56-f403501465fb due to event {{(pid=71026) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478376.1921594, c3b2f425-b988-4b5d-8b56-f403501465fb => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:19:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] VM Resumed (Lifecycle Event)
Jul 27 17:19:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance running successfully.
Jul 27 17:19:36 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance soft rebooted successfully.
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:19:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478376.1932223, c3b2f425-b988-4b5d-8b56-f403501465fb => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:19:36 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] VM Started (Lifecycle Event)
Jul 27 17:19:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-672b0dcd-1e43-4ffb-889e-9d31eeb0eb01 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.152s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:36 user nova-compute[71026]: DEBUG nova.compute.manager [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:19:36 user nova-compute[71026]: WARNING nova.compute.manager [req-128267af-10aa-4e67-83db-8c5c218f16bb req-afb2c043-c2c5-4cf3-9343-909718195206 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state active and task_state None.
Jul 27 17:19:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:49 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:19:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:19:54 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:19:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:19:55 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.286731719970703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 51a787e5-d9ef-4fe2-a899-b214b6efa139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance c3b2f425-b988-4b5d-8b56-f403501465fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:19:55 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:19:56 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:19:57 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [{"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:19:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-51a787e5-d9ef-4fe2-a899-b214b6efa139" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:19:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:19:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:19:57 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:19:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:05 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:20:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:14 user nova-compute[71026]: INFO nova.compute.manager [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Terminating instance
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-unplugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] No waiting events found dispatching network-vif-unplugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-28e16fb5-269d-4a3b-bd59-37d3da839572 req-b7eb2c81-0ede-4a13-bbf1-4f48de04c8a1 service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-unplugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:20:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Instance destroyed successfully.
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.objects.instance [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'resources' on Instance uuid 51a787e5-d9ef-4fe2-a899-b214b6efa139 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1981659796',display_name='tempest-AttachVolumeNegativeTest-server-1981659796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1981659796',id=49,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPYDMx7Oa2NFQztKShQgkxryMFn/o3tkqDlkAqyjniF4hGwJ0OC9oXJzJRgvsMmaUOAZU1Pg4EbDKO7oRT2qpF6l+Ez2MuTq8zifrHOPMjeCvFmtd5IFJnzxS/cKcstAQ==',key_name='tempest-keypair-557337629',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:17:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-miv3f6u2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=51a787e5-d9ef-4fe2-a899-b214b6efa139,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "address": "fa:16:3e:3f:8f:f3", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534e77f8-19", "ovs_interfaceid": "534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG os_vif [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap534e77f8-19, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:14 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:20:14 user nova-compute[71026]: INFO os_vif [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:8f:f3,bridge_name='br-int',has_traffic_filtering=True,id=534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534e77f8-19')
Jul 27 17:20:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Deleting instance files /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139_del
Jul 27 17:20:14 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Deletion of /opt/stack/data/nova/instances/51a787e5-d9ef-4fe2-a899-b214b6efa139_del complete
Jul 27 17:20:15 user nova-compute[71026]: INFO nova.compute.manager [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 27 17:20:15 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:20:15 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:20:15 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:20:15 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:20:15 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Took 0.95 seconds to deallocate network for instance.
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:16 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Deleted allocations for instance 51a787e5-d9ef-4fe2-a899-b214b6efa139
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-d5a04ac2-81c4-4aab-a531-286b5433ae1e tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.238s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] Acquiring lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] Lock "51a787e5-d9ef-4fe2-a899-b214b6efa139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] No waiting events found dispatching network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:20:16 user nova-compute[71026]: WARNING nova.compute.manager [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received unexpected event network-vif-plugged-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 for instance with vm_state deleted and task_state None.
Jul 27 17:20:16 user nova-compute[71026]: DEBUG nova.compute.manager [req-80401276-15ea-48c6-8b6d-6fe2325415d1 req-80ea50af-b0e9-4cee-af87-a1258950d09c service nova] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Received event network-vif-deleted-534e77f8-19d8-4e7e-80a0-35ad3cc3b1a1 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:20:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:24 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:20:29 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478414.8662608, 51a787e5-d9ef-4fe2-a899-b214b6efa139 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:20:29 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] VM Stopped (Lifecycle Event)
Jul 27 17:20:29 user nova-compute[71026]: DEBUG nova.compute.manager [None req-723b5c80-3166-4b70-8393-125f1ee7e919 None None] [instance: 51a787e5-d9ef-4fe2-a899-b214b6efa139] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:20:29 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:20:34 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:39 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:44 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:49 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:20:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:54 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71026) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 27 17:20:56 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:20:56 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:20:56 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.313732147216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:20:56 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance c3b2f425-b988-4b5d-8b56-f403501465fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:20:57 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:20:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:20:59 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:21:04 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:05 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:07 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Starting instance... {{(pid=71026) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71026) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 27 17:21:08 user nova-compute[71026]: INFO nova.compute.claims [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Claim successful on node user
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Start building networks asynchronously for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Allocating IP information in the background. {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] allocate_for_instance() {{(pid=71026) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 27 17:21:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Start building block device mappings for instance. {{(pid=71026) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.policy [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '32fb8f31ad924af19499c72671d0cfd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755fc60deefd4468a017742d1a5f922e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71026) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Start spawning the instance on the hypervisor. {{(pid=71026) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Creating instance directory {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 27 17:21:08 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Creating image(s)
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "/opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "/opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.134s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk 1073741824 {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1,backing_fmt=raw /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk 1073741824" returned: 0 in 0.053s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "474bbdde55080b6cdcdeb8cbbd98a06cf74629c1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/474bbdde55080b6cdcdeb8cbbd98a06cf74629c1 --force-share --output=json" returned: 0 in 0.141s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk. size=1073741824 {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Successfully created port: 66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.virt.disk.api [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Cannot resize image /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk to a smaller size. {{(pid=71026) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.objects.instance [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'migration_context' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Created local disks {{(pid=71026) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Ensure instance console log exists: /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/console.log {{(pid=71026) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Successfully updated port: 66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquired lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Building network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.compute.manager [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-changed-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.compute.manager [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Refreshing instance network info cache due to event network-changed-66b8a413-e4b5-4f15-b304-a96661d17062. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] Acquiring lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Instance cache missing network info. {{(pid=71026) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Releasing lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Instance network_info: |[{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71026) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] Acquired lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Refreshing network info cache for port 66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Start _get_guest_xml network_info=[{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encrypted': False, 'device_type': 'disk', 'image_id': '25ab5798-ce67-493f-a351-9c5665bf837e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 27 17:21:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:21:10 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller missing on host. {{(pid=71026) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.host [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU controller found on host. {{(pid=71026) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71026) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-27T16:30:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-27T16:30:36Z,direct_url=<?>,disk_format='qcow2',id=25ab5798-ce67-493f-a351-9c5665bf837e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bac095afc19c41b6970d6408ce418577',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-27T16:30:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image limits 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flavor pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Image pref 0:0:0 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71026) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Got 1 possible topologies {{(pid=71026) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.hardware [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71026) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-984916983',display_name='tempest-AttachVolumeNegativeTest-server-984916983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-984916983',id=51,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyIV2gJbzPfyJaIO7RgigWKzuMIKbaLik5cpbSsFJAiIbsZ+ujjqigBQtu3k4KFaVJhRg8OOMpemKhAGNFu6MdkzhP2E4rrf8zCJsMK6dULiPZPzXM+fh0Ke/uqPNFU8A==',key_name='tempest-keypair-1079645238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-33tih0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=645bee6c-3d06-468c-b987-925b9e24c6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71026) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'pci_devices' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] End _get_guest_xml xml=<domain type="kvm">
Jul 27 17:21:10 user nova-compute[71026]:   <uuid>645bee6c-3d06-468c-b987-925b9e24c6c3</uuid>
Jul 27 17:21:10 user nova-compute[71026]:   <name>instance-00000033</name>
Jul 27 17:21:10 user nova-compute[71026]:   <memory>524288</memory>
Jul 27 17:21:10 user nova-compute[71026]:   <vcpu>1</vcpu>
Jul 27 17:21:10 user nova-compute[71026]:   <metadata>
Jul 27 17:21:10 user nova-compute[71026]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 27 17:21:10 user nova-compute[71026]:       <nova:package version="0.0.0"/>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:name>tempest-AttachVolumeNegativeTest-server-984916983</nova:name>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:creationTime>2023-07-27 17:21:10</nova:creationTime>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:flavor name="m1.tiny">
Jul 27 17:21:10 user nova-compute[71026]:         <nova:memory>512</nova:memory>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:disk>1</nova:disk>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:swap>0</nova:swap>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:ephemeral>0</nova:ephemeral>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:vcpus>1</nova:vcpus>
Jul 27 17:21:10 user nova-compute[71026]:       </nova:flavor>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:owner>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:user uuid="32fb8f31ad924af19499c72671d0cfd4">tempest-AttachVolumeNegativeTest-881744709-project-member</nova:user>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:project uuid="755fc60deefd4468a017742d1a5f922e">tempest-AttachVolumeNegativeTest-881744709</nova:project>
Jul 27 17:21:10 user nova-compute[71026]:       </nova:owner>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:root type="image" uuid="25ab5798-ce67-493f-a351-9c5665bf837e"/>
Jul 27 17:21:10 user nova-compute[71026]:       <nova:ports>
Jul 27 17:21:10 user nova-compute[71026]:         <nova:port uuid="66b8a413-e4b5-4f15-b304-a96661d17062">
Jul 27 17:21:10 user nova-compute[71026]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 27 17:21:10 user nova-compute[71026]:         </nova:port>
Jul 27 17:21:10 user nova-compute[71026]:       </nova:ports>
Jul 27 17:21:10 user nova-compute[71026]:     </nova:instance>
Jul 27 17:21:10 user nova-compute[71026]:   </metadata>
Jul 27 17:21:10 user nova-compute[71026]:   <sysinfo type="smbios">
Jul 27 17:21:10 user nova-compute[71026]:     <system>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="product">OpenStack Nova</entry>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="version">0.0.0</entry>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="serial">645bee6c-3d06-468c-b987-925b9e24c6c3</entry>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="uuid">645bee6c-3d06-468c-b987-925b9e24c6c3</entry>
Jul 27 17:21:10 user nova-compute[71026]:       <entry name="family">Virtual Machine</entry>
Jul 27 17:21:10 user nova-compute[71026]:     </system>
Jul 27 17:21:10 user nova-compute[71026]:   </sysinfo>
Jul 27 17:21:10 user nova-compute[71026]:   <os>
Jul 27 17:21:10 user nova-compute[71026]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 27 17:21:10 user nova-compute[71026]:     <boot dev="hd"/>
Jul 27 17:21:10 user nova-compute[71026]:     <smbios mode="sysinfo"/>
Jul 27 17:21:10 user nova-compute[71026]:   </os>
Jul 27 17:21:10 user nova-compute[71026]:   <features>
Jul 27 17:21:10 user nova-compute[71026]:     <acpi/>
Jul 27 17:21:10 user nova-compute[71026]:     <apic/>
Jul 27 17:21:10 user nova-compute[71026]:     <vmcoreinfo/>
Jul 27 17:21:10 user nova-compute[71026]:   </features>
Jul 27 17:21:10 user nova-compute[71026]:   <clock offset="utc">
Jul 27 17:21:10 user nova-compute[71026]:     <timer name="pit" tickpolicy="delay"/>
Jul 27 17:21:10 user nova-compute[71026]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 27 17:21:10 user nova-compute[71026]:     <timer name="hpet" present="no"/>
Jul 27 17:21:10 user nova-compute[71026]:   </clock>
Jul 27 17:21:10 user nova-compute[71026]:   <cpu mode="custom" match="exact">
Jul 27 17:21:10 user nova-compute[71026]:     <model>Nehalem</model>
Jul 27 17:21:10 user nova-compute[71026]:     <topology sockets="1" cores="1" threads="1"/>
Jul 27 17:21:10 user nova-compute[71026]:   </cpu>
Jul 27 17:21:10 user nova-compute[71026]:   <devices>
Jul 27 17:21:10 user nova-compute[71026]:     <disk type="file" device="disk">
Jul 27 17:21:10 user nova-compute[71026]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 27 17:21:10 user nova-compute[71026]:       <source file="/opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk"/>
Jul 27 17:21:10 user nova-compute[71026]:       <target dev="vda" bus="virtio"/>
Jul 27 17:21:10 user nova-compute[71026]:     </disk>
Jul 27 17:21:10 user nova-compute[71026]:     <interface type="ethernet">
Jul 27 17:21:10 user nova-compute[71026]:       <mac address="fa:16:3e:87:9d:7b"/>
Jul 27 17:21:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:21:10 user nova-compute[71026]:       <mtu size="1442"/>
Jul 27 17:21:10 user nova-compute[71026]:       <target dev="tap66b8a413-e4"/>
Jul 27 17:21:10 user nova-compute[71026]:     </interface>
Jul 27 17:21:10 user nova-compute[71026]:     <serial type="pty">
Jul 27 17:21:10 user nova-compute[71026]:       <log file="/opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/console.log" append="off"/>
Jul 27 17:21:10 user nova-compute[71026]:     </serial>
Jul 27 17:21:10 user nova-compute[71026]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 27 17:21:10 user nova-compute[71026]:     <video>
Jul 27 17:21:10 user nova-compute[71026]:       <model type="virtio"/>
Jul 27 17:21:10 user nova-compute[71026]:     </video>
Jul 27 17:21:10 user nova-compute[71026]:     <rng model="virtio">
Jul 27 17:21:10 user nova-compute[71026]:       <backend model="random">/dev/urandom</backend>
Jul 27 17:21:10 user nova-compute[71026]:     </rng>
Jul 27 17:21:10 user nova-compute[71026]:     <controller type="usb" index="0" model="none"/>
Jul 27 17:21:10 user nova-compute[71026]:     <memballoon model="virtio">
Jul 27 17:21:10 user nova-compute[71026]:       <stats period="10"/>
Jul 27 17:21:10 user nova-compute[71026]:     </memballoon>
Jul 27 17:21:10 user nova-compute[71026]:   </devices>
Jul 27 17:21:10 user nova-compute[71026]: </domain>
Jul 27 17:21:10 user nova-compute[71026]:  {{(pid=71026) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-984916983',display_name='tempest-AttachVolumeNegativeTest-server-984916983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-984916983',id=51,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyIV2gJbzPfyJaIO7RgigWKzuMIKbaLik5cpbSsFJAiIbsZ+ujjqigBQtu3k4KFaVJhRg8OOMpemKhAGNFu6MdkzhP2E4rrf8zCJsMK6dULiPZPzXM+fh0Ke/uqPNFU8A==',key_name='tempest-keypair-1079645238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-33tih0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-27T17:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=645bee6c-3d06-468c-b987-925b9e24c6c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG os_vif [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4') {{(pid=71026) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66b8a413-e4, may_exist=True, interface_attrs={}) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66b8a413-e4, col_values=(('external_ids', {'iface-id': '66b8a413-e4b5-4f15-b304-a96661d17062', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:9d:7b', 'vm-uuid': '645bee6c-3d06-468c-b987-925b9e24c6c3'}),), if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:10 user nova-compute[71026]: INFO os_vif [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4')
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:87:9d:7b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updated VIF entry in instance network info cache for port 66b8a413-e4b5-4f15-b304-a96661d17062. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG nova.network.neutron [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:21:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-29146f3d-36e6-4612-a7df-2fe4257768cc req-9fe74c77-3a27-4667-9139-9176dda72838 service nova] Releasing lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:21:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:11 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG nova.compute.manager [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:21:12 user nova-compute[71026]: WARNING nova.compute.manager [req-72fc971c-2385-43ba-bce3-2e324c91af0c req-dc01ee04-3ba3-4c16-8960-a9072b6035d8 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state building and task_state spawning.
Jul 27 17:21:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478473.9523115, 645bee6c-3d06-468c-b987-925b9e24c6c3 => Resumed> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:21:13 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] VM Resumed (Lifecycle Event)
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Instance event wait completed in 0 seconds for  {{(pid=71026) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Guest created on hypervisor {{(pid=71026) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 27 17:21:13 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Instance spawned successfully.
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_cdrom_bus of ide {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_disk_bus of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_input_bus of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_pointer_model of None {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_video_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:13 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Found default for hw_vif_model of virtio {{(pid=71026) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 27 17:21:14 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.virt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Emitting event <LifecycleEvent: 1690478473.9548912, 645bee6c-3d06-468c-b987-925b9e24c6c3 => Started> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:21:14 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] VM Started (Lifecycle Event)
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71026) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 27 17:21:14 user nova-compute[71026]: INFO nova.compute.manager [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 27 17:21:14 user nova-compute[71026]: INFO nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Took 5.45 seconds to spawn the instance on the hypervisor.
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:14 user nova-compute[71026]: DEBUG nova.compute.manager [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:21:14 user nova-compute[71026]: WARNING nova.compute.manager [req-d5b6bbef-d58d-41d9-9db6-979c73051c9c req-9783f7d8-5a47-4450-b8ab-0a0423745028 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state building and task_state spawning.
Jul 27 17:21:14 user nova-compute[71026]: INFO nova.compute.manager [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Took 6.02 seconds to build instance.
Jul 27 17:21:14 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-84802b50-8503-4656-89c8-526e54a7fe99 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.114s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG nova.compute.manager [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing instance network info cache due to event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:21:20 user nova-compute[71026]: DEBUG nova.network.neutron [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated VIF entry in instance network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-485bb7de-a771-4314-9ced-99ba741a19f6 req-9842e65c-61fe-4900-8ed6-00c662865ac1 service nova] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.compute.manager [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing instance network info cache due to event network-changed-c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.network.neutron [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Refreshing network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:21 user nova-compute[71026]: INFO nova.compute.manager [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Detaching volume 1f733ad6-00d5-4371-92ed-82fbef1b8372
Jul 27 17:21:21 user nova-compute[71026]: INFO nova.virt.block_device [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Attempting to driver detach volume 1f733ad6-00d5-4371-92ed-82fbef1b8372 from mountpoint /dev/vdb
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Attempting to detach device vdb from instance c3b2f425-b988-4b5d-8b56-f403501465fb from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:21:21 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:21:21 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:21:21 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:21:21 user nova-compute[71026]:   <serial>1f733ad6-00d5-4371-92ed-82fbef1b8372</serial>
Jul 27 17:21:21 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:21:21 user nova-compute[71026]: </disk>
Jul 27 17:21:21 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:21:21 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully detached device vdb from instance c3b2f425-b988-4b5d-8b56-f403501465fb from the persistent domain config.
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3b2f425-b988-4b5d-8b56-f403501465fb from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:21:21 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:21:21 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:21:21 user nova-compute[71026]:   <source dev="/dev/sdc"/>
Jul 27 17:21:21 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:21:21 user nova-compute[71026]:   <serial>1f733ad6-00d5-4371-92ed-82fbef1b8372</serial>
Jul 27 17:21:21 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:21:21 user nova-compute[71026]: </disk>
Jul 27 17:21:21 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated VIF entry in instance network info cache for port c1575975-d9c1-4aad-9323-45824e6f2c98. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.network.neutron [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-939af20a-a25e-4af3-8ced-90b6e95fe0ad req-a3efa530-0ebb-4036-9211-7b0c2ab3e859 service nova] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690478482.3549678, c3b2f425-b988-4b5d-8b56-f403501465fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:21:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully detached device vdb from instance c3b2f425-b988-4b5d-8b56-f403501465fb from the live domain config.
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GsFAZbRy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:21:22 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[af130f33-af3c-40ea-a561-abb8be341d2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:21:22 user nova-compute[71026]: No targets found.
Jul 27 17:21:22 user nova-compute[71026]: iSNS:
Jul 27 17:21:22 user nova-compute[71026]: No targets found.
Jul 27 17:21:22 user nova-compute[71026]: STATIC:
Jul 27 17:21:22 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372
Jul 27 17:21:22 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:21:22 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:21:22 user nova-compute[71026]: FIRMWARE:
Jul 27 17:21:22 user nova-compute[71026]: No targets found.
Jul 27 17:21:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:21:22 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:21:22 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3b4290-00bf-4688-ba3b-d745df6886f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ddbff-e30e-4ab2-8f84-b8fbd465a70e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:21:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 (non-flash)
Jul 27 17:21:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30a807e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372'): ({'sdc'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Removing single pathed devices sdc {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[92343ff3-00c0-4068-9a72-56db870a7a27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f114288-abd0-4dc2-902e-a4aecc630040]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Flushing IO for device /dev/sdc {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93842d0-fc1d-480b-83d2-3f7a180e1f25]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fb787d-5e1d-4d4a-9e1a-50fbd8a32cad]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] SCSI volumes sdc have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e140c59-f434-459e-9d92-515926f78863]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f312d94-778b-4493-a894-79f64e6b131f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260]
Jul 27 17:21:22 user nova-compute[71026]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372, portal: 172.16.0.220,3260] successful.
Jul 27 17:21:22 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f733ad6-00d5-4371-92ed-82fbef1b8372 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b12bbf6-129f-48d3-878d-3d027b549bff]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] <== disconnect_volume: return (278ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:21:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:21:23 user nova-compute[71026]: DEBUG nova.objects.instance [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'flavor' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:21:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-1ce1d47c-4124-405e-b1cd-d6c595bf07e3 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:25 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:21:25 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:21:25 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:21:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:35 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:40 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:45 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:50 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:21:51 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:52 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:21:55 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [{"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-c3b2f425-b988-4b5d-8b56-f403501465fb" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:21:58 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:21:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:22:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:22:00 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.275936126708984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance c3b2f425-b988-4b5d-8b56-f403501465fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 645bee6c-3d06-468c-b987-925b9e24c6c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Triggering sync for uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:06 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:09 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:22:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:20 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:21 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:21 user nova-compute[71026]: INFO nova.compute.manager [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Terminating instance
Jul 27 17:22:21 user nova-compute[71026]: DEBUG nova.compute.manager [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Instance destroyed successfully.
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.objects.instance [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lazy-loading 'resources' on Instance uuid c3b2f425-b988-4b5d-8b56-f403501465fb {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1559789036',display_name='tempest-TestMinimumBasicScenario-server-1559789036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1559789036',id=50,image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbf7gye6yr7Jr9RhSd897J/b23p1dZalN8LZ/E+KdxuRkB3/B41m+PhcNoJRZmNOwRoy/zLlpHLxEBZCtCzpgBzDGWRtA8qpHY2Lx828bxusKZQgF8djJ0NtGt6obg39A==',key_name='tempest-TestMinimumBasicScenario-1175109659',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:17:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='789c6f3e53b643728abe414f52d33edc',ramdisk_id='',reservation_id='r-62tagehm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2e7fe1b3-3c8f-413e-be33-25db21950413',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-860753275',owner_user_name='tempest-TestMinimumBasicScenario-860753275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:19:36Z,user_data=None,user_id='820e443fd72d4e2c90a31c8b63ef495c',uuid=c3b2f425-b988-4b5d-8b56-f403501465fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converting VIF {"id": "c1575975-d9c1-4aad-9323-45824e6f2c98", "address": "fa:16:3e:c4:26:09", "network": {"id": "45d825c0-c7fc-47b6-9c3b-b53339b3e3a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-706466030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "789c6f3e53b643728abe414f52d33edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1575975-d9", "ovs_interfaceid": "c1575975-d9c1-4aad-9323-45824e6f2c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG os_vif [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1575975-d9, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:22 user nova-compute[71026]: INFO os_vif [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:26:09,bridge_name='br-int',has_traffic_filtering=True,id=c1575975-d9c1-4aad-9323-45824e6f2c98,network=Network(45d825c0-c7fc-47b6-9c3b-b53339b3e3a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1575975-d9')
Jul 27 17:22:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Deleting instance files /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb_del
Jul 27 17:22:22 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Deletion of /opt/stack/data/nova/instances/c3b2f425-b988-4b5d-8b56-f403501465fb_del complete
Jul 27 17:22:22 user nova-compute[71026]: INFO nova.compute.manager [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 17:22:22 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:22:22 user nova-compute[71026]: DEBUG nova.compute.manager [req-a1e91745-502a-4420-8e51-f42923a6d582 req-64832ce5-e6a4-4cd3-b899-aec37a285ecd service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-unplugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:22:23 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Took 0.55 seconds to deallocate network for instance.
Jul 27 17:22:23 user nova-compute[71026]: DEBUG nova.compute.manager [req-c24c01ae-c7e6-4899-9aa1-22548b57ffeb req-8943ed67-560a-4062-8012-60983bb75e4b service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-deleted-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:22:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:23 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Deleted allocations for instance c3b2f425-b988-4b5d-8b56-f403501465fb
Jul 27 17:22:23 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-92e53ce6-fd22-4e0b-a170-76f1fe4a8058 tempest-TestMinimumBasicScenario-860753275 tempest-TestMinimumBasicScenario-860753275-project-member] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.742s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:22:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] Acquiring lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:24 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] Lock "c3b2f425-b988-4b5d-8b56-f403501465fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:24 user nova-compute[71026]: DEBUG nova.compute.manager [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] No waiting events found dispatching network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:22:24 user nova-compute[71026]: WARNING nova.compute.manager [req-8430f4f5-8aec-48f4-a747-cab28cf6d79e req-08dd3dd5-10ea-4faf-a51e-1e5ed4662ce5 service nova] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Received unexpected event network-vif-plugged-c1575975-d9c1-4aad-9323-45824e6f2c98 for instance with vm_state deleted and task_state None.
Jul 27 17:22:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478542.7132182, c3b2f425-b988-4b5d-8b56-f403501465fb => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:22:37 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] VM Stopped (Lifecycle Event)
Jul 27 17:22:37 user nova-compute[71026]: DEBUG nova.compute.manager [None req-33925845-6c41-41a2-878d-a1261aaff4da None None] [instance: c3b2f425-b988-4b5d-8b56-f403501465fb] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:22:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:22:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:53 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:22:58 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-changed-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.manager [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Refreshing instance network info cache due to event network-changed-66b8a413-e4b5-4f15-b304-a96661d17062. {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] Acquiring lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] Acquired lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Refreshing network info cache for port 66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 27 17:22:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:22:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.303119659423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 645bee6c-3d06-468c-b987-925b9e24c6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:22:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:23:00 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updated VIF entry in instance network info cache for port 66b8a413-e4b5-4f15-b304-a96661d17062. {{(pid=71026) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 27 17:23:00 user nova-compute[71026]: DEBUG nova.network.neutron [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:23:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-fe99175e-194a-4fce-b79a-204457308819 req-abac27c6-1a6c-4b55-8fca-fbd883309704 service nova] Releasing lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:23:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:23:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:23:01 user nova-compute[71026]: DEBUG nova.objects.instance [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:23:02 user nova-compute[71026]: INFO nova.compute.manager [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Attaching volume dedb4bd0-4503-4fee-b3df-5629b5591ad3 to /dev/vdb
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.utils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33cc020-5d2d-4e90-a660-a429ec43d466]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:3e7b25dfffd3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1411f2c-5e52-4495-9f6e-d84e0c4e574f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0bfb11-dbaf-4a74-b708-031506d0ab6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce33ab8-36cb-41ae-93ec-4b6b51f1c607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Running cmd (subprocess): nvme version {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] 'nvme version' failed. Not Retrying. {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] nvme not present on system {{(pid=71026) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 27 17:23:02 user nova-compute[71026]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 27 17:23:02 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e8431-2140-46f4-938b-c903a7da5ba4]: (4, '') {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71026) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.lightos [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] LIGHTOS: no hostnqn found. {{(pid=71026) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG os_brick.utils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:3e7b25dfffd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG nova.virt.block_device [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating existing volume attachment record: 60506049-9ac3-45de-b975-2a6de353d2cf {{(pid=71026) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 27 17:23:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:05 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:06 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:07 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Calling os-brick to attach iSCSI Volume {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZitsAnh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:23:08 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:23:08 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:23:08 user nova-compute[71026]: INFO os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9c3bad-9682-498f-879f-f29097947167]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 27 17:23:08 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172e48e-6d7b-4209-90cc-cfddf608b5d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3] added\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3] added
Jul 27 17:23:08 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2a74f-9afa-4f2e-9a3f-c6f5aeb7208b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:08 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48c250e-d9b1-4078-b21b-ab893665d2cf]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZitsAnh {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WZitsAnh" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7c8e5-4e7e-4516-b40e-be13f755e92a]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WZitsAnh'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee88d45e-80a8-4221-a000-bfbe39ce69ab]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[471feb30-5c1c-4440-8857-4adc11956c38]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:23:09 user nova-compute[71026]:  {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 27 17:23:09 user nova-compute[71026]:  {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:23:09 user nova-compute[71026]: WARNING os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 27 17:23:09 user nova-compute[71026]: 
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --login {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec3c65-393d-4668-8684-3b413d87a8d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260]
Jul 27 17:23:09 user nova-compute[71026]: Login to [iface: default, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260] successful.
Jul 27 17:23:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b62b51-692e-41b4-88d4-a3057c7e21ed]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a918ab0-9294-45ff-bd6d-0d115912f8d5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)
Jul 27 17:23:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)
Jul 27 17:23:09 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to 172.16.0.220:3260 {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=71026) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71026) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181eab5-0b63-4a51-92b6-538aa50f51b3]: (4, ('- - 0', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71026) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 27 17:23:09 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZitsAnh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71026) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23037613537373262', 'path': '/dev/sdb'} {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037613537373262', 'path': '/dev/sdb'} {{(pid=71026) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.objects.instance [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] attach device xml: <disk type="block" device="disk">
Jul 27 17:23:10 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:23:10 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:23:10 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:23:10 user nova-compute[71026]:   <serial>dedb4bd0-4503-4fee-b3df-5629b5591ad3</serial>
Jul 27 17:23:10 user nova-compute[71026]: </disk>
Jul 27 17:23:10 user nova-compute[71026]:  {{(pid=71026) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vda, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71026) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] No VIF found with MAC fa:16:3e:87:9d:7b, not building metadata {{(pid=71026) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 27 17:23:10 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-77833d75-590c-4a28-9681-22360da78592 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.629s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:23:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:23:12 user nova-compute[71026]: INFO nova.compute.manager [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Detaching volume dedb4bd0-4503-4fee-b3df-5629b5591ad3
Jul 27 17:23:12 user nova-compute[71026]: INFO nova.virt.block_device [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Attempting to driver detach volume dedb4bd0-4503-4fee-b3df-5629b5591ad3 from mountpoint /dev/vdb
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Attempting to detach device vdb from instance 645bee6c-3d06-468c-b987-925b9e24c6c3 from the persistent domain config. {{(pid=71026) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:23:12 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:23:12 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:23:12 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:23:12 user nova-compute[71026]:   <serial>dedb4bd0-4503-4fee-b3df-5629b5591ad3</serial>
Jul 27 17:23:12 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:23:12 user nova-compute[71026]: </disk>
Jul 27 17:23:12 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:23:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 645bee6c-3d06-468c-b987-925b9e24c6c3 from the persistent domain config.
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 645bee6c-3d06-468c-b987-925b9e24c6c3 from the live domain config. {{(pid=71026) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.guest [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] detach device xml: <disk type="block" device="disk">
Jul 27 17:23:12 user nova-compute[71026]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 27 17:23:12 user nova-compute[71026]:   <source dev="/dev/sdb"/>
Jul 27 17:23:12 user nova-compute[71026]:   <target dev="vdb" bus="virtio"/>
Jul 27 17:23:12 user nova-compute[71026]:   <serial>dedb4bd0-4503-4fee-b3df-5629b5591ad3</serial>
Jul 27 17:23:12 user nova-compute[71026]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 27 17:23:12 user nova-compute[71026]: </disk>
Jul 27 17:23:12 user nova-compute[71026]:  {{(pid=71026) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-e9231355-e5d7-4c77-88c9-5eabbeb06817 None None] Received event <DeviceRemovedEvent: 1690478592.7041569, 645bee6c-3d06-468c-b987-925b9e24c6c3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71026) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.driver [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 27 17:23:12 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully detached device vdb from instance 645bee6c-3d06-468c-b987-925b9e24c6c3 from the live domain config.
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] calling os-brick to detach iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f30b744e950>, {'target_iqn': 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WZitsAnh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 27 17:23:12 user nova-compute[71026]: WARNING os_brick.initiator.connectors.base [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3217fc-6383-4bbe-b96d-982a8ac67de9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 27 17:23:12 user nova-compute[71026]: No targets found.
Jul 27 17:23:12 user nova-compute[71026]: iSNS:
Jul 27 17:23:12 user nova-compute[71026]: No targets found.
Jul 27 17:23:12 user nova-compute[71026]: STATIC:
Jul 27 17:23:12 user nova-compute[71026]: Target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3
Jul 27 17:23:12 user nova-compute[71026]:         Portal: 172.16.0.220:3260,-1
Jul 27 17:23:12 user nova-compute[71026]:                 Iface Name: default
Jul 27 17:23:12 user nova-compute[71026]: FIRMWARE:
Jul 27 17:23:12 user nova-compute[71026]: No targets found.
Jul 27 17:23:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 27 17:23:12 user nova-compute[71026]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 27 17:23:12 user nova-compute[71026]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71026) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3', 0)] {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b24a70-166d-4d23-8839-3a0200cb7051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad8d3de-de9e-45f4-b95c-1bad98256209]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)
Jul 27 17:23:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 (non-flash)
Jul 27 17:23:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f30685224d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3'): ({'sdb'}, set())}) {{(pid=71026) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Removing single pathed devices sdb {{(pid=71026) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d7134-dc4b-4606-8dbb-fe0789585412]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[b231f020-b71d-4f34-a42d-790572f8e273]: (4, ('ok\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Flushing IO for device /dev/sdb {{(pid=71026) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[507b848f-486e-4f32-b01a-9e0dc2aa6262]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71026) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[07132549-ac58-412b-bc3c-68c675a8020c]: (4, ('1', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.linuxscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] SCSI volumes sdb have been removed. {{(pid=71026) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3')] {{(pid=71026) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c6fdd5-c3ee-434d-9cd2-f56f7b74e535]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --logout {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d5122-e13f-46f1-8695-bc4c814408ac]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260]
Jul 27 17:23:12 user nova-compute[71026]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3, portal: 172.16.0.220,3260] successful.
Jul 27 17:23:12 user nova-compute[71026]:  stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op delete {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dedb4bd0-4503-4fee-b3df-5629b5591ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82023) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8207b3a-65ea-4ad7-9fa3-4e47ba82fd8b]: (4, ('', '')) {{(pid=82023) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71026) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.base [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] <== disconnect_volume: return (280ms) None {{(pid=71026) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 27 17:23:12 user nova-compute[71026]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Disconnected iSCSI Volume {{(pid=71026) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 27 17:23:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:13 user nova-compute[71026]: DEBUG nova.objects.instance [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'flavor' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:23:13 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-f9568c01-3cb3-4c3b-9942-7269dca57b4b tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.565s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:23:15 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:16 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:17 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:19 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:22 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:27 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:30 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:32 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:37 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:42 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:47 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:52 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:55 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:23:57 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquired lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Forcefully refreshing network info cache for instance {{(pid=71026) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.objects.instance [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lazy-loading 'info_cache' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.network.neutron [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [{"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Releasing lock "refresh_cache-645bee6c-3d06-468c-b987-925b9e24c6c3" {{(pid=71026) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 27 17:23:58 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updated the network info_cache for instance {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.processutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71026) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 27 17:23:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:23:59 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:23:59 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8813MB free_disk=25.34088134765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:23:59 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Instance 645bee6c-3d06-468c-b987-925b9e24c6c3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71026) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1678}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:24:00 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:02 user nova-compute[71026]: INFO nova.compute.manager [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Terminating instance
Jul 27 17:24:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Start destroying the instance on the hypervisor. {{(pid=71026) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG nova.compute.manager [req-f69ef808-f79c-4401-83f7-81393fdb8ef2 req-32a2a907-e041-43bb-b951-fbce36bbba78 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with task_state deleting. {{(pid=71026) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 27 17:24:02 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Instance destroyed successfully.
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.objects.instance [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lazy-loading 'resources' on Instance uuid 645bee6c-3d06-468c-b987-925b9e24c6c3 {{(pid=71026) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.virt.libvirt.vif [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-27T17:21:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-984916983',display_name='tempest-AttachVolumeNegativeTest-server-984916983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-984916983',id=51,image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyIV2gJbzPfyJaIO7RgigWKzuMIKbaLik5cpbSsFJAiIbsZ+ujjqigBQtu3k4KFaVJhRg8OOMpemKhAGNFu6MdkzhP2E4rrf8zCJsMK6dULiPZPzXM+fh0Ke/uqPNFU8A==',key_name='tempest-keypair-1079645238',keypairs=<?>,launch_index=0,launched_at=2023-07-27T17:21:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='755fc60deefd4468a017742d1a5f922e',ramdisk_id='',reservation_id='r-33tih0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='25ab5798-ce67-493f-a351-9c5665bf837e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-881744709',owner_user_name='tempest-AttachVolumeNegativeTest-881744709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-27T17:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='32fb8f31ad924af19499c72671d0cfd4',uuid=645bee6c-3d06-468c-b987-925b9e24c6c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converting VIF {"id": "66b8a413-e4b5-4f15-b304-a96661d17062", "address": "fa:16:3e:87:9d:7b", "network": {"id": "622ad455-9c40-4083-9f65-12492c9e424f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054678621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "755fc60deefd4468a017742d1a5f922e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66b8a413-e4", "ovs_interfaceid": "66b8a413-e4b5-4f15-b304-a96661d17062", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.network.os_vif_util [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4') {{(pid=71026) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG os_vif [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4') {{(pid=71026) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66b8a413-e4, bridge=br-int, if_exists=True) {{(pid=71026) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:03 user nova-compute[71026]: INFO os_vif [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:9d:7b,bridge_name='br-int',has_traffic_filtering=True,id=66b8a413-e4b5-4f15-b304-a96661d17062,network=Network(622ad455-9c40-4083-9f65-12492c9e424f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66b8a413-e4')
Jul 27 17:24:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Deleting instance files /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3_del
Jul 27 17:24:03 user nova-compute[71026]: INFO nova.virt.libvirt.driver [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Deletion of /opt/stack/data/nova/instances/645bee6c-3d06-468c-b987-925b9e24c6c3_del complete
Jul 27 17:24:03 user nova-compute[71026]: INFO nova.compute.manager [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 27 17:24:03 user nova-compute[71026]: DEBUG oslo.service.loopingcall [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71026) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.compute.manager [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Deallocating network for instance {{(pid=71026) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] deallocate_for_instance() {{(pid=71026) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.network.neutron [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:24:04 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Took 0.91 seconds to deallocate network for instance.
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-eee76794-2b40-42bd-a35f-0da63c7407be req-655ebdfd-6cd6-451f-874c-5ab3a229d030 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-deleted-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: INFO nova.compute.manager [req-eee76794-2b40-42bd-a35f-0da63c7407be req-655ebdfd-6cd6-451f-874c-5ab3a229d030 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Neutron deleted interface 66b8a413-e4b5-4f15-b304-a96661d17062; detaching it from the instance and deleting it from the info cache
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.network.neutron [req-eee76794-2b40-42bd-a35f-0da63c7407be req-655ebdfd-6cd6-451f-874c-5ab3a229d030 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Updating instance_info_cache with network_info: [] {{(pid=71026) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-eee76794-2b40-42bd-a35f-0da63c7407be req-655ebdfd-6cd6-451f-874c-5ab3a229d030 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Detach interface failed, port_id=66b8a413-e4b5-4f15-b304-a96661d17062, reason: Instance 645bee6c-3d06-468c-b987-925b9e24c6c3 could not be found. {{(pid=71026) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: INFO nova.scheduler.client.report [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Deleted allocations for instance 645bee6c-3d06-468c-b987-925b9e24c6c3
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-062fd44c-93f3-47cf-831f-0e66004fbe17 tempest-AttachVolumeNegativeTest-881744709 tempest-AttachVolumeNegativeTest-881744709-project-member] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:04 user nova-compute[71026]: WARNING nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state deleted and task_state None.
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:04 user nova-compute[71026]: WARNING nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state deleted and task_state None.
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:04 user nova-compute[71026]: WARNING nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state deleted and task_state None.
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:04 user nova-compute[71026]: WARNING nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-unplugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state deleted and task_state None.
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Acquiring lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] Lock "645bee6c-3d06-468c-b987-925b9e24c6c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:24:04 user nova-compute[71026]: DEBUG nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] No waiting events found dispatching network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 {{(pid=71026) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 27 17:24:04 user nova-compute[71026]: WARNING nova.compute.manager [req-b93b47f1-fd72-4ea3-865a-4a8179eeb22c req-77e892b5-4099-44be-b96d-1db768de2a10 service nova] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Received unexpected event network-vif-plugged-66b8a413-e4b5-4f15-b304-a96661d17062 for instance with vm_state deleted and task_state None.
Jul 27 17:24:07 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690478643.2296124, 645bee6c-3d06-468c-b987-925b9e24c6c3 => Stopped> {{(pid=71026) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 27 17:24:18 user nova-compute[71026]: INFO nova.compute.manager [-] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] VM Stopped (Lifecycle Event)
Jul 27 17:24:18 user nova-compute[71026]: DEBUG nova.compute.manager [None req-ce3494ae-234c-43b3-a59b-d26de0367ad8 None None] [instance: 645bee6c-3d06-468c-b987-925b9e24c6c3] Checking state {{(pid=71026) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:24:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:24:54 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:24:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:24:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:24:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:24:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:25:01 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:25:01 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.367755889892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:25:01 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:25:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:08 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:57 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:25:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:25:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:25:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:25:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:25:59 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:25:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:26:02 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:26:02 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.365882873535156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:26:02 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:26:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:09 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:10 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:12 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:15 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:23 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:28 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:30 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 27 17:26:30 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] There are 0 instances to clean {{(pid=71026) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 27 17:26:33 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:33 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71026) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 27 17:26:33 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:26:38 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:43 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:26:48 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:53 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:56 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:58 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:26:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:26:59 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:00 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:00 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Starting heal instance info cache {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 27 17:27:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Rebuilding the list of instances to heal {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 27 17:27:00 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Didn't find any instances for network info cache update. {{(pid=71026) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 27 17:27:01 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:27:02 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:02 user nova-compute[71026]: DEBUG nova.compute.manager [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71026) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Auditing locally available compute resources for user (node: user) {{(pid=71026) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:27:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:27:03 user nova-compute[71026]: WARNING nova.virt.libvirt.driver [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=25.364063262939453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=71026) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1080}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1103}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71026) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1112}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing inventories for resource provider df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating ProviderTree inventory for provider df003a51-b9f8-417e-bcc9-71861af955a8 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Updating inventory in ProviderTree for provider df003a51-b9f8-417e-bcc9-71861af955a8 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing aggregate associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, aggregates: None {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Refreshing trait associations for resource provider df003a51-b9f8-417e-bcc9-71861af955a8, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=71026) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.compute.provider_tree [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed in ProviderTree for provider: df003a51-b9f8-417e-bcc9-71861af955a8 {{(pid=71026) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 27 17:27:03 user nova-compute[71026]: DEBUG nova.scheduler.client.report [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Inventory has not changed for provider df003a51-b9f8-417e-bcc9-71861af955a8 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71026) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 27 17:27:04 user nova-compute[71026]: DEBUG nova.compute.resource_tracker [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Compute_service record updated for user:user {{(pid=71026) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1041}}
Jul 27 17:27:04 user nova-compute[71026]: DEBUG oslo_concurrency.lockutils [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=71026) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 27 17:27:08 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:27:11 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:27:13 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:27:14 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:16 user nova-compute[71026]: DEBUG oslo_service.periodic_task [None req-6b40f140-d854-4957-97b5-fee99073f196 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71026) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71026) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71026) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 27 17:27:18 user nova-compute[71026]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71026) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}